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I .  Introduction 


We  have,  in  the  past  fourteen-month  period,  completed  several  major 
research  programs  in  the  supported  area  on  white-light  optical  signal 
processing  and  holography.  The  performances  of  our  tasks  done  were  very 
consistent  with  proposed  research  programs  supported  by  Air  Force  Office  of 
Scientific  Research  Grant  No.  AFOSR-83-OI ^40.  Several  results,  in  part, 
have  been  published  in  various  open  technical  journals  and  have  been 
presented  in  scientific  conferences.  Sample  copies  of  these  papers  are 
included  in  this  annual  report  in  the  subsequent  sections,  to  provide  a 
concise  documentation  of  our  research  program.  In  the  following  sections, 
we  shall  give  an  overview  of  our  research  work  done  in  the  period  from 
March  15,  198^4  to  May  1H,  1985.  We  shall  detail  some  of  those  accomplished 
works.  A  list  of  publications  resulting  from  this  support  is  included  at 
the  end  of  this  report. 

II .  Summary  and  Overview 

The  advances  of  quantum  electronics  have  brought  into  use  the  infrared 
and  visible  range  of  electromagnetic  wave.  The  investigation  of  intensive 
coherent  light  sources  has  permitted  us  to  build  more  efficient  optical 
systems  for  communication  and  signal  processing.  However  coherent  optical 
systems  are  plagued  with  coherent  artifact  noise,  which  frequently  limits 
their  processing  capability.  However,  this  difficulty  has  prompted  us  to 
look  at  optical  processing  from  a  new  standpoint,  and  to  consider  whether 
it  is  necessary  for  all  optical  processing  operations  to  be  carried  out  by 
pure  coherent  sources.  We  have  found  that  many  optical  processings  can  be 
carried  out  either  by  partially  coherent  source  or  white-light  source.  The 
advantages  of  white-light  processings  are:  (1)  It  can  suppress  the  coherent 
artifact  noise;  (2)  the  white-light  sources  are  usually  inexpensive;  (3) 
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the  processing  environment  is  generally  very  relaxed;  (^4)  the  white-light 
system  is  relatively  easy  and  economical  to  operate;  and  (5)  the 
white-light  processor  is  particularly  suitable  for  color  image  processing. 

In  the  following  sections,  we  shall  highlight  some  of  the  research 
done  during  the  period  from  March  15,  198*1  to  May  1H,  1985. 

2.1  Solar-Light  Optical  Signal  Processing  (Section  III). 

We  have  in  this  period  performed  an  experiment  of  optical  signal 
processing  with  natural  solar  light  [1].  We  have  shown  that  a  white-light 
processor  can  be  easily  implemented  with  natural  solar  light  for  optical 
signal  processing.  The  basic  advantage  of  the  solar  optical  processing  is 
that  the  processing  system  does  not  require  to  carry  an  artificial  light 
source,  which  is  very  suitable  for  spaceborne  optical  processing 
application,  in  addition  to  the  simplicity,  versatility,  polychromaticity , 
and  noise  immunity  of  the  white-light  processing  system,  the  solar 
processor  is  very  durable  and  the  operation  is  very  cost  effective. 

2.2  White-Light  Processing  with  Magneto-Optic  Device  (Section  IV) 

We  have  also  in  this  period  performed  an  application  of  a 

magneto-optic  spatial  light  modulator  with  white-light  processing  [2].  The 
spatial  light  modulator  to  white-light  optical  signal  processing  is 
presented.  We  have  shrwn  that  the  magneto-optic  device  responds  to  the 
polarized  white  light,  in  which  a  wide  range  of  color  object  patterns  can 
be  generated.  Since  the  magneto-optic  device  is  a  transmitted  type  spatial 
light  modulator,  it  is  very  suitable  for  real-time  programmable  spatial 
filter  synthesis  and  object  pattern  generation  for  optical  signal 


processings. 


2.3  Measurement  of  Noise  Performance  (Section  V) 

A  measurement  technique  for  the  noise  performance  of  a  white-light 
optical  signal  processor  is  also  performed  in  this  period  [3].  The 
technique  utilizes  a  scanning  photometer  to  trace  out  the  output  noise 
intensity  fluctuation  of  the  optical  system.  The  effect  of  noise 
performance  due  to  noise  perturbation  at  the  input  and  Fourier  planes  is 
measured.  The  experimental  results,  except  for  amplitude  noise  at  the 
input  plane,  show  the  claims  for  better  noise  immunity,  if  the  optical 
system  is  operating  in  the  partially  coherent  regime.  We  have  also 
measured  the  noise  performance  due  to  perturbation  along  the  optical  axis 
of  the  system.  The  experimental  results  show  that  the  resulting  output  SNR 
improves  considerably  by  increasing  the  bandwidth  and  source  size  of  the 
illuminator.  The  optimum  noise  immunity  occurs  for  phase  noise  at  the 
input  and  output  planes.  For  amplitude  noise,  the  optimum  SNR  occurs  at 
the  Fourier  plane.  In  brief,  the  experimental  results  confirm  the 
analytical  results  that  we  recently  evaluated. 

2.M  White-Light  Fourier  Holography  (Section  VI) 

In  this  period  we  have  also  developed  a  technique  for  generating  broad 
spectral  band  Fourier  holograms  with  an  encoded  white  light  source  [^4]. 
Since  this  technique  utilizes  primary  white-light  construction  and 
reconstruction  process,  it  is  quite  suitable  for  color  Fourier  hologram 
image  reconstruction. 

2.5  Optical  Generation  of  Speech  Spectrogram  with  White-Light  Source 

(Section  VII) 

We  have  also  developed  a  technique  of  generating  speech  spectrogram 
with  a  white-light  optical  processor  [5].  Since  the  technique  utilizes  a 


white-light  source,  the  speech  spectrograms  thus  generated  are  frequency 
color-coded  resulting  in  easier  visual  discrimination.  The  temporal-to- 
spatial  conversion  of  speech  signal  is  accomplished  by  means  of  density 
modulation  with  a  CRT  scanner.  The  scaling  procedure  of  tne  speech 
spectrogram  as  well  as  the  frequency  resolution  limit  of  the  system  is 
discussed . 

2.6  Progress  on  Archival  Color  Film  Storage  (Section  VIII) 

In  the  past  fourteen-month  period,  we  have  completed  an  investigation 
of  archival  storage  of  color  films  with  white-light  optical  processing 
technique  [6].  We  have  developed  a  spatially  encoding  technique  such  that 
the  moire  fringe  pattern  inherently  existing  with  the  retrieved  color  image 
can  be  avoided.  To  improve  the  diffraction  efficiency  of  the  film,  we  have 
Introduced  a  bleaching  process  so  that  the  step  of  obtaining  a  positive 
encoded  transparency  can  be  eliminated.  Instead  of  restricting  the 
encoding  processing  in  the  linear  region  of  the  T-E  curve,  we  would  allow 
the  encoding  in  the  linear  region  of  the  D-E  curve,  so  that  a  broader  range 
of  encoding  exposure  can  be  utilized.  Experimental  results  indicate  that 
excellent  color  fidelity,  high  signal  to  noise  ratio,  and  good  resolution 
of  the  reproduced  color  images  can  be  obtained. 

2.7  Contributed  an  Invited  Chapter  of  a  Book  (Section  IX) 

We  have  also  in  the  past  few  months  published  an  invited  chapter  on 
"Recent  Advances  in  White-Light  Image  Processing"  in  the  Advances  in 
Electronics  and  Electron  Physics  Vol.  63»  edited  by  P.  W.  Hawkes  (Academic 
Press  Inc.)  [7].  This  chapter  illustrated  several  important  color  image 
processing  operations  can  be  easily  accomplished  with  white-light 
processor,  for  which  some  of  the  results  can  not  be  obtained  with  digital 
techniques  at  this  time.  We  have  acknowledged  particularly  to  the  support 


of  the  AFOSR.  Without  their  support,  these  results  could  not  have  been 
accomplished . 

2.8  Remarks 

We  have  also,  in  this  period,  investigated  a  microprocessor  based 
real-time  optical  signal  processing.  Interesting  results  would  be  surfaced 
in  the  near  future.  In  short,  the  white-light  signal  processing  research 
program,  supported  by  AFOSR,  is  conducted  extremely  well  as  proposed.  As 
it  can  be  seen,  several  significant  results  have  been  documented  in  open 
literature  available  for  the  interested  technical  and  research  staffs,  for 
example,  as  listed  in  Section  III  to  IX. 

2.9  Future  Research 

Our  aim  in  the  following  years  is  toward  the  following  goals: 

1.  To  synthesize  a  low  cost  microprocessor  based  white-light 
pseudocolor  encoder. 

2.  To  carry  out  the  white-light  programmable  pseudocolor  encoder  for 
multispectral  band  satellite  pictures,  x-ray  transparencies,  scanning 
electron  micrograph,  etc. 

3.  To  develop  a  real-time  programmable  processing  capability  with 
various  spatial-light  modulators. 

i).  To  carry  out  various  real-time  signal  processing  applications. 

5.  To  develop  a  real-time  spatial/spectral  signal  processing 
capability. 

6.  Provide  experimental  demonstrations  and  applications  of  the 
principles  and  processing  operation  that  we  proposed. 

7.  To  develop  techniques  of  synthesizing  a  broad  spectral  band 
complex  matched  filter  for  the  white-light  processing  system. 
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We  will  show  that  a  white-light  processor  can  be  easily  implemented  with  natural  solar  light  for  optical  signal  processing. 
The  basic  advantage  of  the  solar  optical  processing  is  that  the  processing  system  does  not  require  to  carry  an  artificial  light 
source,  which  is  very  suitable  for  spacebome  optical  processing  application.  In  addition  to  the  simplicity,  versatility,  poly- 
chromaticity,  and  noise  immunity  of  the  white-light  processing  system,  the  solar  processor  is  very  durable  and  the  operation 
is  very  cost  effective.  Several  elementary  experimental  demonstrations  obtained  with  the  solar  light  processing  are  given. 


1 .  Introduction 


/(*,>') wexp[iAf{7',(4r,>')]  [1  +sgn(cosp^)] 


Since  the  discovery  of  laser  in  the  earlier  60’s,  the 
laser  has  become  an  indispensable  light  source  for 
most  of  the  optical  signal  processings  [1-4],  Aside 
from  the  disadvantage  of  inherent  artifact  noise,  the 
lasers  are  generally  expensive  and  in  some  cases  the 
maintenance  of  a  coherent  source  could  be  a  prob¬ 
lem.  Recently  we  have  developed  a  grating  based  op¬ 
tical  signal  processing  tedinique,  which  can  be  easily 
carried  out  with  a  broad  band  white-light  source  [S]. 
The  major  advantages  of  the  white-light  processing,  as 
in  contrast  with  the  coherent  counterpart,  are  the 
simplicity,  versatility,  polychromatidty,  cost  effi¬ 
ciency  and  artifact  noise  immunity. 

We  will,  however,  in  this  paper  experimentally 
demonstrate  that  several  elementary  optical  image 
processings  can  be  carried  out  by  solar  or  sun-light 
illumination.  Since  the  solar  light  contains  all  the 
visible  wavelength,  the  experimental  results  that  we 
will  show  would  be  in  colour  images. 

2.  Color  image  rettival 

•  Let  us  briefly  describe  a  color  image  retrieval 
utilizing  the  solar  light.  Let  us  assume  that  a  spa¬ 
tially  encoded  transmittance  of  a  color  object  trans¬ 
parency  be  [6] 


7'b(j:,y)[l  +  sgn(cosp,,x)) 


+  7'g^x,>')[l +sgn(cosppX)]}],  •  (1) 

whereof  is  an  arbitrary  constant,  Tj,  and  are 
the  red,  blue,  and  green  image  irradiances  of  the 
color  object, p,,  pj,,  and  Pg  are  the  respective  carrier 
spatial  frequencies,  (x,y)  is  the  spatial  coordinate  sys¬ 
tem  of  the  encoded  film,  and 


sgn(cos  x)  = 


1 ,  cos  X  >  0  , 
-1,  cosx<0. 


If  we  place  the  encoded  film  of  eq.  (1)  at  the  input 
plane  of  a  solar  optical  processor  of  fig.  1 ,  then  the 
first-order  complex  wave  field  at  the  Fourier  plane, 
for  every  X,  would  be 

S(a,  P;  X) ««  r,  (o,  P  ±  ^  p,)  +  Tb  (a  ±  ^p^. 
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Pig.  1.  A  solar  optical  processor. 
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where  T,,  and  Tj,  are  the  Fourier  transforms  of 
Tj.  T’j,  and  respectively,  •  denotes  the  convolu¬ 
tion  operation,  and  the  proportional  constants  have 
been  neglected  for  simplicity.  We  note  that  the  last 
cross  product  term  of  eq .  (2)  would  introduce  a 
moird  fringe  pattern,  which  can  be  easily  masked  out 
at  the  Fourier  plane.  Thus  by  proper  color  filtering 
the  smeared  Fourier  spectra  as  illustrated  in  fig.  1 ,  a 
true  color  image  can  be  retrieved  at  the  output  image 
plane  P3.  The  corresponding  output  image  irradiance 
would  be 


/(x,>')«=exp(iA/{r,(*,.v)(l  +sgn(cosp,>')] 
+  +  sgnfcospjar)] 


I(x,y)  =  T^(x,y)  +  T^{x,y)  +  rj(x,y) ,  (3) 

which  is  a  superposition  of  three  primary  encoded 
color  images.  Thus  we  see  that  a  moird  free  color 
image  can  be  retrieved  from  a  natural  solar  light. 

For  experimental  demonstration,  we  show  a  re¬ 
trieved  color  image  of  fig.  2  obtained  from  the  solar 
light  optical  processing.  In  view  of  the  retrieved 
color  image,  we  see  that  the  reproduced  color  image 
is  spectacularly  faithful  with  respect  to  the  original 
color  object  and  the  image  contains  virtually  no  co¬ 
herent  artifact  noise. 


3.  Pseudocolor  encoding 

Most  of  tlic  optical  images  obtained  In  various 
scientific  applications  are  gray-level  density  images. 
For  example,  scanning  electron  microscopic  images, 
multispectral  band  aerial  photograpltic  images,  X-ray 
transparencies,  infar-red  scanning  images,  etc.  How¬ 
ever,  humans  can  perceive  in  color  better  than  gray- 
level  variations.  Therefore  a  color  coded  image  can 
provide  a  greater  ability  in  visual  discrimination. 

Let  a  three-level  (i.e.,  positive,  negative  and  inter¬ 
mediate  level)  ^atially  encoding  transparency  be 


+  7'3('*.>’)[1 +sgn(cosp3x)]}],  -(4) 

where  Af  is  an  arbitrary  constant,  7*1,  T2.  and  are 
the  positive,  the  negative,  and  the  negative  and  posi¬ 
tive  product  image  exposures.^  j  .P2,  and  are  the 
respective  carrier  spatial  frequencies. 

Again  by  the  insertion  of  the  encoded  transparen¬ 
cy  of  eq.  (4)  at  the  input  plane  p  j  of  the  solar  light 
processor  of  fig.  1 ,  and  by  various  color  filtering  of 
the  smeared  Fourier  spectra  in  the  Fourier  plane,  a 
density  color  coded  image  can  be  obtained  at  the 
output  plane,  such  as 

/(x,y)-  7"?,(x,y)  +  r^g(x,.v)  . 

where  and  7*3^  are  the  red,  blue,  and  green 

color  intensity  distributions  ot  the  three  spatially  en¬ 
coded  images.  Titus  we  see  that  a  density  color  coded 
image  can  be  easily  obtained  with  the  solar  light. 

Fig.  3  shows  a  density  pseudocolor  encoded  X-ray 
image  of  a  woman's  pelvis,  obtained  with  the  solar 
processor  of  fig.  1 .  In  this  color  encoded  image,  the 
positive  image  is  encoded  in  red.  the  negative  image  is 
encoded  in  blue,  while  the  product  image  is  encoded 
in  green.  By  comparing  the  pseudocolor  coded  image 
with  the  original  X-ray  picture,  it  appears  that  the 
soft  tissues  can  be  better  differentiated  by  the  color 
coded  image. 
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Fig.  4.  Samples  of  false-colot  Landsat  images,  (a)  Band  4  is  encoded  in  green  while  band  5  is  encoded  in  red.  (b)  Band  4  is  encoded 
in  green,  band  5  is  encoded  red,  and  band  7  is  encoded  blue. 
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4.  As  apply  to  inultispcctral  Laiulsat  images 

I'iilst-color  cuciulcd  Laiulsiil  images  would  allow 
us  for  llic  discrimination  of  various  earth  surface  fea¬ 
tures.  For  example,  forests  agricultural  lands,  water, 
urban  areas,  and  strip  mines  can  be  shown  on  the 
color  coded  images  if  each  of  the  thematic  image 
were  displa)  ed  in  a  different  color.  With  reference  to 
the  spatial  encoding  method  as  described  previously,  a 
iV-spectral  band  encoded  transparency  may  be  de¬ 
scribed  as 

A/2 

t(x.y)’^exp  Ml  Z)  7'„(x,j')[l +sgn(cosp^)] 

L  \n=2k*l 

N/2 

+  T/  r„(x,y)[l-t-sgn(cosp„x)]n  ,  k=l,2,..., 
n=2k  '  /J  ^5^ 

where  T„  are  the  multispectral  band  image  irradiances. 
We  note  that  the  use  of  the  orthogonal  samplings 
(i.e.,  spatial  encoding  directions)  is  to  avoid  the  moire 
fringes  of  the  output  image.  Needless  to  say  that  if 
the  encoded  film  of  eq.  (5)  is  inserted  at  the  input 
plane  of  the  solar  optical  processor,  then  false-color 
encoding  can  be  taken  place  in  Fourier  plane.  The 
output  false-color  coded  image  irradiances  can  be 
shown  as 

A 

/(x,y)=S  r2(x,>-;X„),  (6) 

1 

where  represents  the  irradiance  of  nth  spectral 
band  image  and  denotes  the  corresponding  coded 
color.  Tlius  we  see  that  a  false-color  coded  multi¬ 
spectral  image  can  be  easily  obtained  with  the  solar 
light  processing. 

For  simplicity,  three  bands  of  multispectral  scan¬ 
ner  Landsat  data  were  processed  for  pseudocoloring. 
Tliese  bands  were  from  the  blue-green  (band  4:  0.5- 
0.6  t/m),  red  (band  5:  0.6— 0.7  ftm),  and  reflected  in¬ 
frared  (band  7;  0.8- 1.1  um)  spectral  regimes.  The 
scene  is  a  78  X  107  km  subsample  of  Landsat  scene 
showing  a  section  of  Susquehanna  River  Valley  in 
S<iuthe:isieii)  I’eimsylvania.  Fig.  4  shows  the  results  of 
the  false-color  coded  Landsat  data  obtained  with  the 
solar  optical  processor  of  fig.  1 .  In  fig.  4(a)  where 
band  4  is  encoded  green  and  band  5  is  encoded  red, 
the  Susquehanna  River  and  small  bodies  of  water  arc 
delineated  as  deep  red.  The  islands  in  the  Susquehanna 
River  are  easily  distinguished.  Strip  mines  are  dark 
red,  urban  areas  (Harrisburg)  are  medium  red,  and 


agricultural  lands  arc  light  red,  orange,  and  yellow. 
I'oiesiril  iirpiis  air  girrn.  In  fig.  4(b),  where  band  4  Is 
encoded  green,  band  5' is  encoded  red,  and  band  7  is 
encoded  blue,  the  Susquehanna  River  appears  as 
violet,  and  the  other  bodies  of  water  as  shades  of  blue. 
Hie  surface  mines  and  urban  areas  arc  dark  red.  The 
agricultural  valleys  are  orange  and  the  forested  re¬ 
gions  are  green.  Thus  again  we  see  tltat  false-color 
coded  images  can  be  easily  obtained  with  a  solar  op¬ 
tical  processor. 

S.  Conclusion 

We  have  demonstrated  that  a  white-light  optical 
processor  can  also  utilize  natural  solar  light  for  image 
processing.  One  of  the  obvious  advantages  of  the 
solar  light  optical  processing  is  that  the  system  does 
not  require  to  carry  its  own  light  source.  Tlius  the 
proposed  solar  optical  processor  is  very  suitable  for 
spaceborne  or  satellite  optical  processing  applications. 
One  can  image  that  if  an  orbiting  spaceborne  satellite 
optical  processor  is  required  to  carry  its  own  light 
source,  for  example  a  powerful  laser,  then,  aside  the 
havier  payload,  the  question  is  that  how  long  the 
light  source  will  last?  If  one  used  the  natural  solar 
li^t,  we  can  easily  perceive  that  the  optical  system 
would  continue  to  function  for  a  great  number  of 
years,  possibly  beyond  the  present  civilization.  Al¬ 
though  the  development  of  the  solar  optical  processing 
is  still  in  the  infancy  stage  however  it  is  not  difficult 
to  predict  that  it  would  offer  many  useful  applica¬ 
tions,  particularly  to  the  space  corrununication  and 
signal  processing  needs. 

We  wish  to  acknowledge  the  support  of  the  US  Air 
Force  Office  of  Scientific  Research  grant  AFOSR-83- 
0140. 
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Application  of  a  magnetooptic  spatial  light  modulator  to 
white-light  optical  processing 

Francis  T.  S.  Yu,  Xiaojing  Lu,  and  Miaofu  Cao 


The  application  of  a  programmable  magnetooptic  spatial  light  modulator  to  white-light  optical  signal  pro¬ 
cessing  is  presented.  We  have  shown  that  the  magnetooplic  device  responds  to  the  polarized  white  light, 
in  which  a  wide  range  of  color  object  patterns  can  be  generated.  Since  the  magnetooptic  device  is  a  trans¬ 
mitted  type  spatial  light  modulator,  it  is  very  suitable  for  real-time  programmable  spatial  filter  synthesis 
and  object  pattern  generation  for  optical  signal  processings.  Experimental  demonstrations  of  some  of  the 
elementary  spatial  filter  syntheses  and  pseudocolor  encodings  are  provided. 


I.  Introduction 

The  recent  development  of  magnetooptic  spatial  light 
modulator  (also  called  Light-M^)  has  stimulated  po¬ 
tential  applications  to  the  real-time  optical  signal  pro- 
cessing.^-2  The  Light-Mod  consists  of  a  layer  of  mag¬ 
netic  iron -garnet  thin  film  deposited  on  a  transparent 
nonmagnetic  substrate.  The  magnetic  thin  film  is, 
however,  formed  into  a  2-D  array  of  separated  mag¬ 
netically  bistable  mesas  or  pixels.  As  a  plane  polarized 
light  transmits  through  the  array  of  the  mesas,  the  po¬ 
larization  of  the  mesas  can  be  spatially  modulated  by 
magnetically  switching  through  the  Faraday  effect. 
Since  the  Light-Mod  is  a  transparent  type  device  unlike 
the  other  spatial  light  modulators,^-^  the  device  is  very 
suitable  for  the  applications  to  real-time  object  pattern 
generation  and  spatial  filter  synthesis. 

Because  of  the  cross-array  formation  of  the  mesas,  the 
device  has  a  2-D  mesh  structure  for  which  the  array  of 
mesas  or  pixels  can  be  switched  on  and  off  with  an  x-y 
matrix  addressed  of  currents.  Thus  each  pixel  of  the 
Light-Mod  would  take  one  of  the  only  two  possible 
states,  which  depends  on  the  direction  in  which  the  pixel 
is  magnetized.  Thus  we  see  that  the  Light-Mod  is  es¬ 
sentially  a  binary  type  spatial  light  modulator  (SLM) 
in  contrast  with  the  other  SLM. 

Since  the  Light-Mod  can  be  electrically  switched,  an 
object  pattern  can  be  written  on  the  device  with  a 
computer;  thus  the  Light-Mod  is  also  a  programmable 
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spatial  light  modulator,  which  is  particularly  attractive 
to  the  application  to  programmable  optical  pro¬ 
cessing. 

In  this  paper  we  will,  however,  illustrate  some  ap¬ 
plications  of  this  magnetooptics  device  to  a  white-light 
optical  signal  processor.  We  will  show  that  the  device 
is  capable  of  generating  various  elementary  spatial  fil¬ 
ters  and  object  patterns  for  optical  processings.  Since 
the  device  would  be  used  in  a  white-light  optical  pro¬ 
cessor,  we  will  first  demonstrate  the  effect  of  the.  device 
under  the  polarized  white-light  illumination.  We  will 
show  that  the  device  responds  to  a  wide  range  of  polar¬ 
ized  light,  and  it  is  suitable  for  generating  color-coded 
spatial  filters  and  color -coded  object  patterns. 

II.  Effect  under  White-Light  Illumination 

We  shall  first  illustrate  the  effect  of  spectra  distri¬ 
bution  under  white-light  iUumination.  Since  the  device 
is  essentially  an  n  X  m  array  of  transparent  pixels  (or 
mesas),  the  Fourier  spectra  of  the  device  would  have  a 
similar  distribution  to  that  of  a  2-D  cross  grating.  If  we 
insert  the  Light-Mod  in  the  input  plane  of  a  white-light 
processor,  we  would  expect  a  set  of  smeared  rainbow 
color  Fourier  spectra  distributed  at  the  spatial  fre¬ 
quency  plane.  Since  the  current  Light-Mod  under  test 
would  not  respond  to  wavelengths  shorter  than  the 
green  light,  their  Fourier  spectra  would,  therefore,  only 
smear  from  red  to  green.  Nevertheless,  this  range  of 
spectral  lines  would  provide  us  with  a  wide  variety  of 
colors  for  the  polychromatic  processing. 

To  simplify  our  discussion  on  the  effect  under  the 
white-light  illumination,  we  provide  three  simple  object 
patterns  of  the  device,  as  illustrated  in  the  left-hand 
column  of  Fig.  1.  The  center  column  is  a  set  of  equa¬ 
tions  to  represent  the  Fourier  transforms  of  these  object 
patterns,  where  1//  is  the  spatial  frequency  of  the  in-, 
herent  grating  structure  of  the  device,  a  is  the  pixel  size, 
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Fig.  1. 


Elementary  patterns  of  the  device  and  the  corresponding  smeared  Fourier  spectra. 


X  is  the  wavelength  of  illumination,  and  f  is  the  focal 
length  of  the  transform  lens.  The  corresponding 
smeared  Fourier  spectra  distributions  are  also  shown 
in  the  right-hand  column  of  the  same  figure. 

Let  us  now  discuss  the  effect  of  the  device  under  the 
polarized  white-light  illumination.  We  assume  that  an 
object  pattern,  used  either  as  a  spatial  filter  or  as  an 
input  object,  is  generated  by  the  device  with  a  pro¬ 
grammable  computer.  If  the  device  is  illuminated  by 
a  polarized  white-light,  one  would  see  the  color  of  the 
object  pattern  changes  as  the  direction  of  the  polariza¬ 
tion  changes.  Since  the  device  responds  to  a  broad 
spectral  bandwidth  of  light  from  red  to  green,  a  wide 
variety  of  color  object  patterns  can  be  generated  in 
which  the  color  characterization  of  the  device  is  shown 
in  Fig.  2.  In  this  figure  the  outer  region  represents  the 
magnetized  pixels  (i.e.,  object  pattern),  and  the  inner 
region  represents  the  unmagnetized  pixels  (i.e.,  back¬ 
ground).  For  example,  if  the  polarizer  is  set  at  ~88® 
angle  relative  to  the  vertical  axis  of  the  device,  the  object 
pattern  would  be  in  yellow  color,  which  has  the  greatest 
transmittance,  while  the  background  would  be  in  black, 
as  can  be  seen  in  Fig.  2.  If  the  polarizer  is  turned 
slightly  counterclockwise,  one  would  see  that  the  object 
pattern  remains  in  yellow  color  while  the  background 
changes  to  dark  green  color  (or  red  color,  if  the  polarizer 
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Fig.  2.  Color  transmittant  characteristic  of  the  magnetooptic  device 
under  polarized  white-light  illumination. 

is  rotated  slightly  clockwi.se).  If  further  advancing 
counterclockwise,  the  background  would  become  light 
green  while  the  object  pattern  still  remains  in  yellow. 
We  further  note  that,  if  the  polarizer  is  set  at  ~104®,  a 
contrast  reverse  of  the  color  object  pattern  appears.  If 
the  polarizer  is  set  between  180  and  95.5®,  the  entire 
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Pig.  3.  White-light  optical  signal  processing  utilizing  a  program¬ 
mable  spatial  niter:  /,  white-light  source;  //(a,/3),  spatial  filter 
generated  by  the  device;  L,  transform  lens. 


device  would  become  yellowish,  a  contrast  reverse  color 
pattern  would  take  place  for  further  turning  of  the  po¬ 
larizer.  Moreover,  from  Fig.  2  we  see  that  the  color 
characterizations  of  the  dev  ice  are  repeated  for  every 
rotation  of  the  polarizer.  Thus  a  wide  range  of  color 
object  patterns  can  be  generated  for  polychromatic 
signal  processing. 

III.  Elementary  Spatial  Filtering 

We  shall  now  discuss  the  utilization  of  the  Light-Mod 
as  a  programmable  spatial  filter  for  a  white-light  optical 
processing  as  shown  in  Fig.  3.  We  note  that  the  device 
is  driven  by  a  computer  to  generate  elementary  binary 
spatial  filters  (e.g.,  high-pass  and  wedge  filters). 

Since  the  inherent  grating  structure  of  the  device 
produces  higher -order  diffractions  (as  shown  in  Fig.  1), 
the  separation  of  these  higher-order  signals  is  depending 
on  the  sampling  frequency  (i.e.,  the  grating  structure) 
of  the  device,  and  the  spatial  frequency  content  of  the 
arriving  complex  wave  field.  In  other  words,  it  depends 
on  the  pixel  size  of  the  device,  the  frequency  content  of 
the  object  sfiectra,  and  the  focal  length  of  the  transform 
lens. 

We  shall  now  investigate  the  effect  of  the  output 
image  irradiance  due  to  the  device  used  as  a  program¬ 
mable  spatial  filter.  With  reference  to  Fig.  3,  the  in¬ 
tensity  distribution  at  the  output  plane  can  be  written 
as® 


7"'IS(o.^;A)W(a.0))  «  s(zo’)  • 


where  7"’  denotes  the  inverse  Fourier  transformation, 
•.  represents  the  convolution  operation,  S{a,0;X)  is  the 
Fourier  spectrum  of  the  input  signal  s(xo')ffHa,0)  is  the 
amplitude  transmittance  of  the  device  used  as  a  spatial 
filer,  h{x,y;\)  is  the  corresponding  impulse  response, 
6  is  the  Dirac  delta  function,  and  (x,.v)  and  (a,0)  are  the 
spatial  coordinate  systems.  From  this  equation  we  see 


tliiil  the  input  Higniil  is  curried  nut  by  iin  in  X  />i  I  army 
<»f  «menn*«l  ilell/i  fiinrlinnH  .wliich  nre  liicnled  iil 

I  X/ 

I  /  1 1 

in  the  output  plane  We  al.m  note  that  the  inten.sity 
of  t  he  inuh  i|>le  iirniy  of  out  pul  HiKunlH  (nr  iiiiiii'CH)  ih 
pro|)ortional  to  magnitude  square  of  the  sine  factors  in 
Eq.  (1),  i.e., 

/n.in(j:,.v)a'j  sine  y||  |sinc|my||  •  (2) 

Thus  the  intensity  of  the  higher -order  images  decreases 
rapidly  as  n  and  m  increase.  We  would,  however,  treat 
the  zero  order  (i.e.,  m  =  n  =  0)  as  the  signal  and  the  rest 
of  the  diffracted  orders  as  noise.  Thus  to  improve  the 
output  SNR.  one  would  make  the  ratio  a/l  (where  a  g 
/)  approached  to  unity.  However,  to  make  the  size  of 
the  pixel  approach  the  size  of  the  mesh  cell  of  the  device 
is  equivalent  to  saying  that  making  the  x-y  drive  lines 
very  thin  is  very  difficult  to  achieve  in  practice.  Nev¬ 
ertheless,  if  the  mesh  cell  of  device  /  is  made  smaller  and 
the  focal  length  of  transform  lens  { is  made  longer,  the 
separation  of  the  output  signal  with  respect  to  the  un¬ 
wanted  noise  (i.e.,  higher-order  diffractions)  can  be 
obtained.  As  a  numerical  example;  given  /  =  0.127  mm 
for  a  48-  X  48-array  Light-Mod  and  /  =  1000  mm,  the 
mean  separation  of  the  output  smeared  signals  would 
be  X///  =  4.3  mm  for  X  =  5500  A.  If  /  =  0.02  mm.  the 
mean  separation  of  smeared  signals  would  be  *^27.5  mm 
for  the  same  focal  length.  Thus  the  input  signal  size 
could  be  as  large  as  14  mm. 

IV.  Experimental  Results 

In  our  experiments,  we  show  that  a  piece  of  48-  X 
48-array  magnetooptics  light-mod  is  used  to  generate 
elementary  spatial  filter  in  the  Fourier  plane  of  a 
white-light  optical  processor  as  depicted  in  Fig.  3.  The 
pixel  size  of  the  device  is  ~0.127  mm,  and  the  size  of  the 
light-mod  is  ~V4  in.  square.  Needless  to  say  that  ele¬ 
mentary  spatial  filters  can  be  generated  by  the  device 
with  a  programmable  computer.  Now  if  we  assume  a 
high-pass  filter  as  shown  in  Fig.  4(a)  is  being  generated 
in  the  Fourier  plane,  an  edge-enhanced  image  can  be 
obtained  at  the  output  plane  of  the  processor.  Since  the 
magnelooptic  device  responds  to  a  broad  band  of  light 
waves  (i.e..  from  red  to  green),  it  is.  therefore,  a  simple 
matter  of  utilizing  the  device  to  generate  a  color  coded 
high-pass  spatial  filter.  In  example,  if  the  polarizer  is 
set  at  an  angle  between  9.5. .5  and  104®  of  Fig.  2,  a  high- 
|MiH,s  color-coded  filler  of  Fig.  4(ul  can  Ik*  generated  (i.e., 
low-pass  region  is  in  dark  green,  while  high-pass  region 
is  in  yellow).  And  it  is  apparent  that  a  color-coded 
edge-enhanced  image  can  be  observed  at  the  output 
plane. 

For  experimental  demonstration.  Fig.  4(b)  shows  a 
gray  scale  black-and-white  input  object.  Figure  4(c) 
is  a  black-and-white  picture  of  the  corresponding 
color-coded  edge-enhanced  image  obtained  with  the 
programmable  spatial  filler  with  white-light  processing. 
In  the  original  color  image,  the  edges  of  the  building  are 
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Fig.  4.  Edge  enhancement:  (a)  black-and-white  picture  of  a 
,  color-coded  high-pass  filter  generated  by  the  device;  in  reality,  the 
low-pass  region  is  green,  and  the  high-pass  region  is  yellow;  (b)  input 
object  transparency;  (c)  black-and-white  color-coded  edge-enhanced 
image.  In  reality,  the  edges  of  the  building  are  yellow-white,  and  the 
rest  of  the  picture  is  greenish. 


(c)  (d) 

Fig.  5.  Directional  filtering:  (a)  black-and-white  picture  of  a  wedge 
filter;  (b)  input  signal;  (c)  extraction  of  the  larger  signal;  (d)  extraction 
of  the  smaller  signal. 


Fig.  6.  White-light  processor  with  a  programmable  input  object  for 
pseudocolor  encoding:  I,  white-light  source;  L,  transform  lens. 


(a) 

Fig.  7.  I'seiidocolor  encoding:  (a)  Input  object;  (b)  object  pattern 
generated  by  the  device;  (c)  a  black-and-white  color -coded  iamge.  In 
color  the  bird  is  yellow,  the  square  region  is  in  green,  and  the  outer 
region  is  reddish. 

mostly  coded  in  yellow,  while  the  rest  of  the  picture  is 
greenish  color.  Needless  to  say  that,  if  the  polarizer  is 
set  at  a  different  angle,  a  different  shade  of  color-coded 
edge-enhanced  image  can  be  obtained. 

We  shall  now  show  a  second  experimental  result  ob¬ 
tained  with  a  directional  or  wedge  filter®  "  of  Fig.  5. 
Figure  5(a)  shows  a  two-shade  radial  spectral  filter 
generated  by  the  device.  Figure  5(b)  shows  a  black- 
and-white  input  object  of  two  sinusoidal  waves  taken 
from  a  oscilloscope.  Although  these  Isvo  sinusoidal 
waveforms  are  of  the  same  frequency,  however,  the 
slopes  of  these  two  waveforms  are  very  distinctive. 
Thus  these  two  sinusoids  of  different  amplitudes  can 
be  exclusively  extracted  with  a  wedge  filter.  Figures 
5(c)  and  (d)  show  a  set  of  the  results  obtained  by  the 
wedge  filter  of  Fig.  5(a),  with  two  sequential  settings  of 
the  polarizer:  Fig.  5(c)  is  obtained  when  the  vertical 
region  of  the  wedge  filter  is  coded  in  black,  while  the 
horizontal  region  is  coded  in  yellow.  Figure  5(d)  is 
obtained  with  a  contrast  reversed  filter  of  Fig.  5(n). 

We  shall  now  demonstrate  a  theta  modulation® 
pseudocolor  encoding  technique  with  this  device  as 
shown  in  Fig.  6.  First,  a  binary  black-and-white  input 
object  of  Fig.  7(a)  is  placed  at  the  observation  plane  P. 
Then  a  pattern  of  input  object  can  be  generated  by  the 
Light-Mod  with  a  programmable  computer  as  shown 
in  Fig.  6.  The  object  pattern  of  the  device  consists  of 
three  distinctive  spatially  modulated  regions  as  shown 
in  Fig.  7(b).  The  inner  region  (i.e.,  the  bird)  is  mo- 
dualted  with  a  uniform  cross-grating  frequency  in  both 
directions,  while  the  intermediate  region  is  not  modu¬ 
lated,  and  the  outer  region  is  modulated  at  a  lower 
grating  frequency  in  the  horizontal  direction.  Thus  the 
corresponding  smeeued  object  pattern  spectra  would  be 
spatially  separated  along  the  horizontal  axis  in  Fourier 
plane.  In  pseudocolor  encoding,  we  allow  the  zero- 
order  (i.e.,  the  intermediate  region)  and  two  first-order 
(i.e.,  the  bird  and  the  outer  region)  Fourier  spectra  to 
pass  through  three  preselected  color  filters,  (e.g.,  red, 
green,  and  yellow),  respectively,  at  the  spatial  frequency 
plane  of  Fig.  6.  Then  a  pseudocolor-coded  image  can 
be  obtained  at  the  output  plane  as  shown  in  a  black- 
and-white  picture  of  Fig.  7(c).  Needless  to  say,  differ¬ 
ent  shades  of  pseudocolor  encoded  images  can  also  be 
obtained  with  different  sets  of  the  color  filters  and  dif¬ 
ferent  settings  of  the  polarizer  orientations.  Thus  a 
wide  range  of  pseudocolor  images  can  be  obtained  with 
the  theta  modulation  technique. 


py 111 
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V.  Conclusion 

In  (-onclilRion,  w»>  liiiv*  iiM-<ir)Mirfilr'(|  »  proKriiiiininlilp 
niiit<ii*-l4M)|>li(' h|iiiLiiil  liKlil  iiKxliiltiitir  willi  ii  winu*  li){lil 
optical  signal  i>rocea.Hor.  We  have  shown  that  the  device 
reM|Htntle(l  P'  polari/ed  while  liKhl,  in  which  il  olTers  Ihe 
a<lvnnta||e  of  color-c<Ml<‘(l  spatiiil  I'iIttTs  Hvnl.hesis  and 
the  general  ion  of  pHi*ii«liM-oliir  olii<><'l  in4;c.  'The  di'vice 
can  he  used  as  an  input  prot'rammahle  object  and  also 
as  a  proi'rammnhle  spatial  filler  for  real-time  optical 
signal  pr«)ccsainf;.  Kvcn  though  the  resolution  of  this 
device  is  rather  limited,  however,  we  have  shown  some 
tlie  interestitiK  iipplicali<iii.s  with  the  white-lif'ht  illu¬ 
mination.  Nevertheless,  one  of  the  important  assets 
of  the  device  must  l)e  the  proRrammahility,  which,  in 
principle,  would  offer  a  wide  range  of  real-time  pro¬ 
cessing  capabilities.  If  the  resolution  of  the  device  is 
further  improved,  the  device  would  have  significant 
impact  to  the  application  of  modern  optical  signal 
processing. 

We  acknowledge  the  Litton  Data  Systems  for  support 
of  the  Light-Mod  investigation  and  the  support  of  U.S. 
Air  Force  Office  of  Scientific  Research  grant  AFOSR- 
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Measurement  of  noise  performance  for  a  white-light 
optical  signal  processor 

Francis  T.  S.  Yu,  Le-Nian  Zheng,  and  Fu-Kuo  Hsu 


A  measurement  technique  for  the  noise  performance  of  a  white-light  optical  signal  processor  is  presented. 
The  technique  ulilize-sa  scanning  photometer  to  trace  out  the  output  noi.se  intensity  fluctuation  of  the  opti¬ 
cal  system.  The  effect  of  noise  performance  due  to  noise  perturbation  at  the  input  and  Fourier  planes  is 
measured.  The  experimental  results,  except  for  amplitude  noise  at  the  input  plane,  show  the  claims  for  bet¬ 
ter  noise  immunity,  if  the  opttcal  system  is  operating  in  the  partially  coherent  regime.  We  have  also  mea¬ 
sured  the  noise  performance  due  to  perturbation  along  the  optical  axis  of  the  system.  The  experimental  re¬ 
sults  show  that  the  resulting  output  SNR  improves  considerahly  hy  increasing  the  bandwidth  and  source 
size  of  the  illuminator.  The  optimum  noise  immunity  occurs  fur  phase  noise  at  the  input  and  output  planes. 
For  amplitude  noise,  the  optimum  SNR  occurs  at  the  Fourier  plane.  In  brief,  the  experimental  results  con¬ 
firm  the  analytical  results  that  we  recently  evaluated. 


I.  Introduction 

White-light  optical  processors  are  known  to  perform 
better  in  noisy  conditions  compared  with  coherent  op¬ 
tical  processors,  because  the  artifact  noise  in  the  co¬ 
herent  optical  system  is  unavoidable.  The  analysis  of 
noise  performance  under  coherent  and  partial  coherent 
regimes  has  been  quantitatively  studied  by  Cbavel  and 
Lowenthal‘  and  Chavel.^  Thev  show  that  noise  fluc¬ 
tuations  caused  by  the  pupil  plane  can  be  drastically 
reduced  under  broadband  illumination.  They  have  also 
pointed  out  that  the  noise  at  the  object  plane  due  to 
defects  other  than  the  phase  deviations  cannot  be 
suppressed  under  partially  coherent  illumination. 

Recently.  Leith  and  Roth^  studied  the  noise  perfor¬ 
mance  of  an  achromatic  coherent  optical  processor. 
They  demonstrated  that  such  a  system  shows  consid¬ 
erable  noise  immunity  if  a  broad  spectral  band  source 
is  employed.  More  recently,  we  analyzed  the  perfor¬ 
mance  of  a  white-light  optical  processor  under  noisy 
environment.^-® 

We  have  shown  that  except  for  the  case  when  the 
amplitude  noise  is  present  at  the  input  plane,  the  re¬ 
sulting  output  SNR  improves  considerably  by  in- 
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creasing  the  number  of  filter  channels  (or  equivalently 
the  spectral  bandwidth)  and  the  size  of  the  light  source 
employed. 

In  this  paper,  we  shall  experimentally  measure  the 
noise  performance  of  a  white-light  optical  processor. 
We  shall  show  that  the  measured  results  confirm  the 
analytical  predictions."’  ®  Aside  from  the  noise  effects 
at  the  input  and  Fourier  planes,  we  have  also  measured 
the  noise  performance  due  to  thin  noise  effects  along  the 
longitudinal  direction  (i.e.,  Z  axis)  of  a  white-light  op¬ 
tical  system. 

II.  Noise  Measurement 

The  white-light  optical  signal  processor  to  be  studied 
here  is  described  in  Fig.  1.  The  processor  is  similar  to 
that  of  a  coherent  optical  processor,  except  for  the  use 
of  an  extended  white-light  source,  source  encoding 
mask,  sampling  phase  grating,  and  achromatic  Fourier 
transform  lenses.  The  output  light  intensity  distri¬ 
bution  due  to  the  nth  narrow  spectral  band  spatial  filter 
in  the  Fourier  jflane  can  be  determined  by  the  following 
integral  equation^-**: 

.S'lio  +  o  -  X/i'o.,vp  +  diHnIa.dl 

■exp  -I  —  u'o  +  \ '5)  dx(^y(vd\,  (1) 

where  •ylxn.yu)  represents  the  intensity  distribution  of 
the  light  source  at  Po.  X/,n  and  X/n  are  the  longest  and 
shortest  limiting  wavelengths  of  the  nth  spectral  band 
filter  (a./3),  5(X(i -I-  n  —  X/i'o,_vo+  /3)  is  the  smeared 
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I'iK.  I.  (■iriitiiiK-liiiml  whiK  lit:ht  nplicnl  priKcssor: 
■yixii.vn).  source  intensiiy  distribulions;  l\,.  source 
plane;  !'\,  input  plane;  Fourier  plane;  /'i.  output 
plane;  '(x.v),  object  transparency;  slit  fil¬ 

ler:  PM,  photometer;  OSC.  oscilloscope;  L,  achro¬ 
matic  transform  lenses. 


F  ourier  spectra  of  the  input  object  .s{x,y),H„  {a,0)  is  the 
nth  spectral  band  spatial  filter  corresponding  to  the  nth 
channel  in  the  system,  f  is  the  focal  length  of  the  ach¬ 
romatic  Fourier  transform  lens,  and  I'o  is  the  spatial 
frequency  of  the  sampling  phase  grating,  which  can  be 
written  as 

T(x)  “  expU2rvox).  (2) 

We  shall  first  investigate  the  noise  performance  of  the 
proposed  white-light  processor  under  the  spatially  co¬ 
herent  illumination,  i.e.,  the  effects  due  to  source  size. 
For  convenience,  we  assume  that  the  source  irradiance 
is  uniform  over  a  square  aperture  at  source  plane  Pq, 
which  can  be  written  as 

tI^OuVo)  “  rect  |^|  rect  |— |  •  (3) 

where 


|o.|xo|>^- 


For  simplicity,  we  assume  that  the  input  signal  is  a 
1-D  object  independent  of  the  y  axis.  The  Fourier 
spectrum  would  also  be  1-D  in  the  0  axis  but  smeared 
into  rainbow  colors  along  the  a  direction.  Let  the  width 
of  the  nth  narrow  spectral  band  filter  be  Aa„.  If  the 
filter  is  placed  in  the  smeared  Fourier  spectra,  the 
spectral  bandwidth  of  the  filter  can  be  written  as 


The  total  number  of  filter  channels  can  be  deter¬ 
mined. 


AX  AXi'o/ 

“  ■  ar 

AX„  Aa„ 


(5) 


where  AX  is  the  spectral  bandwidth  of  the  white-light 
source.  Thus,  we  see  that  the  degree  of  temporal  co¬ 
herence  at  the  Fourier  plane  increases  as  spatial  fre¬ 
quency  of  the  sampling  grating  vo  increases. 
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For  the  noise  measurement  under  temporally  co¬ 
herent  illumination,  we  would  use  a  variable  slit  rep¬ 
resenting  a  broad  spectral  filter  in  the  Fourier  plane. 
The  output  noise  fluctuation  can  be  traced  out  with  a 
linearly  scanned  photometer,  as  illustrated  in  Fig.  1.  It 
is  therefore  apparent  that  the  output  noise  fluctuation 
due  to  spectral  bandwidth  of  the  slit  filter  and  due  to  the 
source  size  can  then  be  separately  determined.  We 
shall  adopt  the  definition  of  output  signal-to-noise  ratio 
(SNR),  as  proposed  in  a  previous  paper for  the  mea¬ 
surement  of  the  noise  performance,  i.e., 

SNRnLv'l  4  £|/„(y')|/o,(v'),  (6) 

where  /n(.v')  is  the  output  irradiance  due  to  the  nth 
channel,  £[•)  denotes  the  ensemble  average,  and 
is  the  variance  of  the  output  noise  fluctuation,  i.e., 

*  E\Il(y')]-\E\I„(y  ’W.  (7) 

Evidently  the  output  intensity  fluctuation  /n(y')  can 
be  traced  out  by  a  linearly  scanned  photometer.  The 
dc  component  of  the  output  traces  is  obviously  the  out 
signal  irradiance  (i.e..  Ej/n]),  and  the  mean  square 
fluctuation  of  the  traces  is  the  variance  of  the  output 
noise  (i.e..  cr^).  Thus  we  see  that  the  effect  of  the  output 
SNR  due  to  spectral  bandwidth  (i.e..  temporal  coher¬ 
ence)  and  source  size  (i.e.,  spatial  coherence)  can  readily 
be  obtained  with  the  proposed  measurement  tech¬ 
nique. 

III.  Experimental  Results 

In  our  experimenus.  a  75-W’  xenon  arc  lamp  is  used  as 
the  white-light  source.  The  spatial  frequency  of  the 
sampling  phase  grating  used  is  ~50  lines/mm,  the  focal 
length  of  the  achromatic  transform  lenses  is  ~380  mm. 
Both  the  amplitude  and  the  phase  noise  plates  used  in 
the  experiments  are  generated  by  photographing  a  laser 
speckle  pattern,  and  the  phase  plate  is  obtained  with  a 
surface  relieving  technique  through  an  R-10  bleaching 
process.''  Shower  glass,  for  strong  phase  perturbation, 
is  also  utilized  in  the  experiments.  We  shall  first 
demonstrate  the  noise  performance  due  to  perturbation 


«T  I)  C 

Kip.  2.  Effect  on  output  imaRe  (with  a  section  of  photometer  traces)  due  to  phase  noise  at  the  input  plane  for  different  spectral  bandwidths. 
The  source  size  used  is  0.7  mm  square  (i.e..  a  =  0.7  mm):  (a)  AX,  «=  1500  A;  (b)  AX„  =  1000  A;  tc)  AX„  -  500  A. 


at  the  input  plane.  For  the  amplitude  noise  at  the  input 
plane,  the  experiments  have  shown  that  there  is  no 
apparent  improvement  in  noise  performance  under 
partially  coherent  illumination.  The  result  is  quite 
conclusive  with  the  previous  prediction.^-^  However 
for  the  phase  noise  at  the  input  plane,  the  noise  per¬ 
formance  of  the  system  is  largely  improved  with  a  par¬ 
tially  coherent  illumination.  We  shall  first  utilize  a 
weak  phase  model  (obtained  by  laser  speckle  and  a 
photographic  bleaching  process  described  earlier)  as  the 
input  noise.  Now  we  consider  the  situation  of  an  input 
object  transparency  superimposing  with  the  phase  noise 
at  the  input  plane.  The  effect  of  the  noise  performance 
of  the  optical  system  can  then  be  obtained  by  varying 
the  source  size  and  the  spectral  bandwidth  of  the  slit 
filter,  as  described  in  Fig.  1.  Figure  2  shows  a  set  of 
output  photographic  images  together  with  sections  of 
corresponding  photometer  traces  to  illustrate  the  effect 
due  to  spectral  bandwidth  of  the  slit  filter.  From  these 
pictures  we  see  that  the  noise  performance  (i.e.,  SNR) 
improves  as  the  spectral  bandwidth  (i.e.,  temporal  co¬ 
herence)  of  the  slit  filter  increases. 

Quantitative  measurements  of  the  noise  performance 
due  to  phase  noise  at  the  input  plane  aire  plotted  in  Figs. 
3  and  4.  From  these  two  figures  we  see  that  the  output 
SNR  increases  monotonically  as  the  spectral  bandwidth 
AXn  of  the  slit  filter  increases  and  it  linearly  increases 
as  the  source  size  enlarges.  Thus  the  noise  performance 
for  a  partially  coherent  optical  system  improves  as  the 
degree  of  coherence  (i.e.,  temporal  and  spatial  coher¬ 
ence)  relaxes.  In  other  words,  to  improve  the  output 
SNR  of  the  white-light  (i.e.,  partially  coherent)  pro¬ 
cessor,  one  can  either  relax  the  spatial  coherence  (i.e.. 
the  source  size)  or  the  temporal  coherence  (i.e.,  the 
spectral  bandwidth  of  the  filter)  or  both  in  the  optical 
processing  system.  We  stress  that  the  experimental 
results  are  quite  compatible  with  the  results  obuined 
in  our  recent  analysis.^-'^ 

Let  us  now  demonstrate  the  effect  of  the  noise  per¬ 
formance  due  to  strong  phase  noise.  In  the  experi¬ 
ments.  a  conventional  shower  glass  is  used  as  the  input 
phase  noise.  Figure  5  shows  a  set  of  results  we  obtained 


Fir.  3.  Output  SNR  for  phase  noise  at  the  input  plane  as  a  function 
of  spectral  bandwidth  of  the  slit  filter  for  various  values  of  source 

sizes. 


/  A  v .  isoo  I 


Fir.  a.  Output  SNR  for  phase  noi.se  at  the  input  plane  as  a  function 
of  source  size  for  various  values  of  spectral  bandwidths. 
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Fig.  6.  Output  SNR  for  amplitude  noise  at  the  Fourier  plane  as  a 
function  of  spectral  bandwidth  for  various  source  sizes. 

tiiuifr  viiriotiH  Hpcct.nil  hiiiulwidlti  jlliiiniiiiifioim. 
ure  5(a)  shows  an  output  result  obtained  under  entire 
broadband  white-Iipht  illumination.  Aithouph  this 
image  is  somewhat  aberrated  due  to  the  thick  phase 
perturbation,  the  image  is  relatively  immune  from 
random  noise  fluctuation.  Compared  with  the  results 
obtained  from  Figs.  5(a)-(d),  we  see  that  the  output 
SNR  decreases  rather  rapidly  as  the  spectral  bandwidth 
of  the  slit  filter  decreases.  Furthermore,  Fig.  5(d)  shows 
a  result  obtained  with  a  narrowband  coherent  source 
(i.e.,  a  He-Ne  laser).  Aside  from  the  poor  noise  per- 
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formance,  we  have  noted  that  the  output  image  is  also 
severely  corrupted  by  coherent  artifact  noise. 

We  shall  now  demonstrate  the  noise  performance  of 
a  white-light  optical  processing  system  due  to  noise  at 
the  Fourier  plane.  With  reference  to  the  same  mea¬ 
surement  technique  as  proposed  in  Fig.  1,  the  effects  of 
amplitude  noise  at  the  Fourier  plane  are  plotted  in  Fig. 
6.  In  contrast  with  the  amplitude  noise  at  the  input 
plane,  we  see  that  the  output  SNR  increases  monoton - 
ically  as  the  spectral  bandwidth  of  the  slit  filter  in¬ 
creases.  The  output  SNR  also  improves  as  the  source 
size  enlarges.  Thus,  for  amplitude  noise  at  the  Fourier 
plane,  the  noise  performance  of  a  white-light  optical 
processor  improves  as  the  degree  of  temporal  and  spatial 
coherence  decreases. 

Figure  7  shows  the  noise  performance  of  a  white-light 
processor  for  phase  noise  at  the  Fourier  plane.  From 
this  figure,  once  again  we  see  that  the  output  RNU  is  a 
OKinototiic  iticrodHing  futictioii  of  Hiicctriil  liaiidwidlh 
AXn.  The  SNR  also  increases  as  the  source  size  in¬ 
creases.  However,  compared  with  the  case  of  phase 
noise  at  the  input  plane  of  Fig.  2,  the  improvement  of 
the  noise  performance  is  somewhat  less  effective  com¬ 
pared  with  the  phase  noise  at  the  input  plane.  Once 
again  we  see  that  the  experimental  results  are  compat¬ 
ible  with  the  analytical  results  that  we  obtained  in  our 
previous  papers.^"'' 

We  shall  now  provide  the  result  of  noise  performance 
due  to  thin  phase  noise  along  the  optical  axis  (i.e.,  Z 
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Kip.  7.  Oul-nii  SNK  fiir  phase  noise  at  the  Fourier  plane  as  n  funcliun 
of  soe.ce  size  for  various  values  of  spectral  bandwidths. 


Fig.  8.  Variation  of  the  output  SNR  due  to  thin  phase  noise  as  a 
function  of  the  Z  direction  for  various  source  sizes. 


Fig.  9.  Variation  of  the  output  SNR  due  to  thin  amplitude  noise  as 
a  lunction  of  the  /  direction  lor  various  s<iurcc  sizes. 


axis)  of  the  optical  system.  Figure  8  shows  the  variation 
of  output  SNR  due  to  phase  noise  inserted  in  various 
planes  of  the  optical  system.  From  this  figure  we  see 
that  the  output  SNR  improves  drastically  for  phase 
noise  inserted  at  the  input  and  output  planes  under 
temporal  and  spatial  partially  coherent  illumination. 
I'he  noise  performance  is  somewhat  less  effective  for  the 
phase  noise  at  the  Fourier  plane,  even  under  partially 


colii'ii'iil  illiiiiiiii)il ion.  Noncl lu'li'sM,  Ihc  phiiHp  noiHc 
«(  the  Fourier  frlntre  can.  in  principle,  he  loUitly  elimi- 
iiiili'il  oiiili’t’  vi-ry  liriiiKlIiiiiirl  illiiiiiiiiiilioii,  ii  (■iii  li  iil  llic 
iioi.se  clijitniei.s  i.s  uncorrelaled.  We  have  al.so  iioled  (hat 
the  output  SNIl  is  soniewhat  lower  for  higher  spatial 
cohereui  iihuuiualiou  (i.e.,  siiialler  source  si/e).  In 
otlu'r  words,  the  output  SNR  can  also  Im'  im|)rove<l  with 
extended  Houree  ilhiiuiniil ion. 

The  noise  |)erformance,  due  to  amplitude  noise  along 
the  /  axis  of  (he  proposed  ojftical  jfroccssor,  is  plotted 
in  Fig.  9.  From  this  figure  we  see  that  the  output  SNR 
improves  as  the  nr»isc  perturhat  ion  moved  away  from 
the  input  and  output  planes  and  where  the  optimum 
SNR  occurs  at  the  Fourier  plane.  Again,  we  see  that  the 
output  SNR  is  somewhat  higher  for  larger  source  sizes 
(i.e.,  lower  degree  of  spatial  coherence).  However  we 
stress  that  the  noise  performance  cannot  be  improved 
with  partially  coherent  illumination,  if  the  amplitude 
noise  is  placed  at  the  input  or  at  the  output  plane. 

IV.  Summary  and  Conclusion 

We  have  devised  a  technique  for  measuring  the  noise 
performance  of  a  white-light  (i.e.,  partially  coherent) 
optical  signal  processor.  We  have  utilized  a  scanning 
photometer  method  to  obtain  the  output  intensity 
traces  of  a  partially  coherent  system  operating  in  noisy 
conditions.  The  effects  of  output  SNR  due  to  the  am¬ 
plitude  and  the  phase  noise  at  the  input  and  Fourier 
planes  were  quantitatively  studied.  The  experimental 
results  show  that  there  has  been  no  improvement  in 
noise  performance  due  to  amplitude  noise  at  the  input 
plane.  However  the  output  SNR  improves  drastically 
for  the  phase  noise  at  the  input  plane  with  a  partially 
coherent  (i.e.,  temporal  and  spatial  coherence)  illumi¬ 
nation.  For  very  strong  input  phase  disturbance,  the 
experiments  show  that  the  output  noise  can  essentially 
be  eliminated,  if  it  is  under  very  broadband  illumina¬ 
tion. 

As  for  the  performance  due  to  noise  at  the  Fourier 
plane,  the  experimental  results  show  that  the  output 
SNR  improves  for  both  the  amplitude  and  phase  noise 
under  a  partially  coherent  regime.  However  the  overall 
improvement  is  somewhat  lower  than  the  effect  due  to 
phase  noise  at  the  input  plane,  under  the  same  partially 
coherent  (i.e.,  temporal  and  spatial  coherence)  illumi¬ 
nation. 

We  have  also  measured  the  noise  performance  due  to 
thin  noise  effects  along  the  Z  axis  of  the  optical  pro¬ 
cessing  system.  The  experimental  results  show  that 
optimum  n*)ise  immunity  occurs  for  phase  n»>ise  at  the 
input  and  output  planes,  and  optimum  output  SNR 
occurs  for  amplitude  noise  at  the  Fourier  plane.  The 
results  also  indicate  that  a  higher  output  SNR  can  in 
fact  be  obtained  for  more  relaxed  temporal  and  spatial 
coherence  constraints. 

In  concluding  this  paper  we  stress  that  the  experi¬ 
mental  results  are  quite  compatible  with  the  analytical 
results  that  we  recently  evaluated.'’-'’ 

We  acknowledge  the  support  of  the  U.S.  Air  Force 
Office  of  Scientific  Research  grant  AFOSR-83-1040. 
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This  paper  describes  a  technique  for  )!cncratint!  broad  spectral  band  1  outicr  hulu)trams  with  an  encoded  white  lipht 
source.  Since  this  technique  utilir.cs  primary  white-light  construction  and  reconstruction  process,  it  is  quite  suitable  ‘'or 
color  I'ourier  hologram  image  reconstruction.  Experimental  results  arc  also  given. 


1 .  Introduction 

The  construction  of  Fourier  transform  hologram 
for  a  two-dimensional  object  transparency  with  co¬ 
herent  optics  was  first  introduced  by  Vander  Lugt 
in  1 964  in  the  application  to  complex  signal  detection 
(1 ).  Since  then  efforts  have  been  made  to  develop 
techniques  for  making  Fourier  holograms  with  inco¬ 
herent  light. 

Recently.  Courjon  and  Bulabois  [2-4]  had  dem¬ 
onstrated  a  technique  of  producing  Fourier  holograms 
with  a  spatially  incoherent  source.  They  utilized  an  in¬ 
terference  filter  and  a  holographic  transparency  to 
achieve  a  high  degree  of  colierence  illuiiiination  for 
the  Fourier  hologram  construction  and  the  hologram 
image  reconstruction  was  obtained  with  narrow  spec¬ 
tral  band  illumination.  Although  good  experimental 
results  have  been  reported,  however  the  technique  is 
bmited  to  monochrome  hologram  image  reconstruc¬ 
tion.  Ferriere  et  al.  [5]  have  also  demonstrated  a  tech¬ 
nique  of  generating  Fourier  holograms  with  an  incoher¬ 
ent  source.  They  utilized  dispersive  prisms  and  a  slit 
filter  to  achieve  a  high  temporal  coherence  (i.e,  nar¬ 
row  band  illumination)  for  Fourier  hologram  genera¬ 
tion.  Although  positive  results  liavc  heeti  reported  in 
their  article,  however  the  image  quality  is  rather  porrr. 
The  major  drawback  of  this  technique  must  be  due  to 
low-light  construction  process,  in  which  results  with 
poor  noise  pcrfortnance. 

In  this  paper  we  shall  describe  a  technique  of  pro¬ 


ducing  a  broad  band  Fourier  hologram  with  a  white- 
light  source.  The  technique  utilizes  a  high  efficient  dis¬ 
persive  grating  and  a  source  encoding  mask  for  the 
Fourier  hologram  generation.  Since  the  hologram  con¬ 
struction  utilizes  all  colors  of  visible  light,  tius  tech¬ 
nique  is  suitable  for  color  Fourier  hologram  image  re¬ 
construction. 


2.  Construction  and  reconstruction  process 

We  shall  now  describe  a  technique  of  generating  a 
broad  spectral  band  Fourier  hologram  with  a  white- 
light  processing  technique  16).  as  schematized  in  fig.  1. 
A  high  diffraction  efficient  phase  grating  is  used  to  dis¬ 
perse  the  spectral  content  of  the  light  source  into  rain¬ 
bow  color  at  the  back  focal  plane  of  the  achromatic 
lens  Lq.  To  alleviate  the  constraint  of  recording  medi¬ 
um  due  to  limited  dynamic  range,  we  shall  spatially 
sample  the  smeared  optical  light  source  with  periodic 
pinholes  such  that  a  sequence  of  partially  coherent 
sources  for  various  spectral  colors  can  be  obtained  at 
the  source  plane  Fq.  The  intensity  distribution  of  these 
encoded  sources,  for  various  ,  would  be 

A' 

=  S  cir„(|jro.  .Vo  - )  .  (1) 

n  =  l 

where  K  is  a  proportionality  constant. 
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I  lf!.  1 .  A  Icchnique  of  generating  a  broad  spectral  band 
I'ouricr  hologram  with  a  white-liplit  source.  S.  white-light 
source. 

cir„  (r/ ]  =  1 ,  0  <  r  <  A/-„  , 

=  0,  otlierwise  , 

is  the  radius  of  the  nth  sampling  pinholes, /is  the 
focal  length  of  the  achromatic  lens,  pq  is  the  spatial 
frequency  of  the  phase  grating.  X„  is  the  main  wave¬ 
length  within  the  nth  sampled  source,  and  (Xq.  Vp)  is 
the  spatial  coordinate  system  of  the  source  plane  Pq. 
To  achieve  the  required  spatial  coherence  at  the  input 
plane  Pj .  it  is  apparent  that  the  size  of  the  sampling 
pinholes  should  be  small  compared  with  the  overall 
input  object,  such  as 

-  (2) 

where  li  denotes  the  separation  between  the  reference 
point  and  the  input  object  .r(x..v)  as  shown  in  fig.  1. 

To  maintain  a  high  temporal  coherence  for  Fourier 
hologram  construction,  it  is  required  that  the  wave¬ 
length  spread  AX„  over  the  nth  sampling  aperture 
should  satisfy  the  following  inequality 

AX„/X„  «  Ap/pq  .  (3) 

where  Ap  is  the  spalial  frequency  bandwidth  of  the  in- 
piil  olijcci  .v(.v.  I’)  and  p^  is  the  spatial  licqucticy  of 
the  phase  grating. 

Thus  we  see  that  a  sequence  of  encoded  partially 
coherent  sources  arc  illuminating  the  input  plane  Pj . 
.Since  the  source  encoding  mask  is  covered  over  a  wide 
spectral  content  of  the  smeared  white-light  sourcc.it 
is  apparent  that  A'  discrete  Fourier  holograms,  for  dif- 


Icicnl  wavelengths,  can  he  syntlicsi/ed.  I  ct  us  now  as¬ 
sume  that  the  input  plane  contains  an  ol>|Cct  transpar¬ 
ency  and  a  reference  pinhole,  as  described  in  the  follow, 
ing  equation: 

/(Jt,.v)  =  s(x  +  /i/2.,v)  +  6(x  -  /r/:,y).  (4) 

where  s(.r.y)  denotes  an  input  object  function.  6 (.v, y) 
denotes  the  Dirac  delta  function,  and  h  is  the  main  sep¬ 
aration  between  the  target  and  the  reference  pinholes. 

It  is  therefore  apparent  that  a  broad  band  Fourier 
hologram  can  be  interferometrically  generated  in  the 
Fourier  plane  Pj.  If  we  assume  that  the  holographic 
construction  is  in  the  linear  region  of  the  recording 
emulsion,  the  amplitude  transmittance  distribution  of 
the  recorded  Fourier  hologram  would  be 

A’ 

E  {A-,|5(q.0+/poX„)|2 
n  =  - A' 
n*0 

4A'2lS(a./3-t/PoX„)| 

X  cos[(2ff;r/X„/)crt-0(a, 0 +/PoX„))}  ,  (-S) 

where  A'j  and  Aj  are  arbitrarily  proportional  constants, 
5(a.  0.  X„)  is  the  Fourier  spectrum  of  input  object  func¬ 
tion  s(x,^'.  X„),  (a,  p)  is  the  spatial  coordinate  system 
of  the  Fourier  plane.  X„  is  the  main  wavelength  of  the 
nth  quasi  monochromatic  coherent  source, /is  the  focal 
length  of  the  achromatic  transform  lens  Lj,  and  vq  is 
the  spatial  frequency  of  the  grating. 


I'ij:.  2.  l  ouricr  liolugram  image  reconstruction  with  while- 
light  processing. 
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ll  In  liilrirsIlM);  lo  tinlr  lli:il  II  llic  Iii():kI  h:iiul  liolo- 
pr;im  Ilia.  0)  is  ilhiniiiuilcd  by  :i  bciint  of  oKCodrcl  wliilc- 
llplil  aiwncc  (kIhiwii  In  llg.  such  us 

\ 

/:  (a,P.X)  =  C  Z/  cir„(a, /3  +  /i'oX„;X).  (( , 

fi  =  -  A 
HiOl 


wlicrc  r  is  a  cDiiipIcx  proporliotialiiy  constant,  then  the 
complex  light  field  at  the  output  plane  would  be 

g(x,):\)=JJ  t'(a,0,\)H(a,0) 

X  exp(-i(2ff/X/)(a!x  + /k))  dad^  .  (7) 

By  substituting  eqs.  (5)  and  (6)  into  eq.  (7).  we  have 
gix,y  \  X) 


A’ 


=  Z/  C,6{X,>’;  X)  •  i(x,  r;  \„)  •  i*(-x,  -v;  X„) 

n=  1 


C26(x.>’;X)  *  [i(jr  +/i,.v;X„) 


+  j*(-x  +7i,  ->':X„)]  , 


(8) 


where  Cj  and  are  complex  constants.  *  denotes  the 
convolution  operation  and  the  superscript  •  represents 
the  complex  coniunction.  The  corresponding  output 
irradiance  can  be  shown  as 


Hx,y)=  f  i^),„\g(x,y\><)\^<i>^. 

which  is  approximated  by 


for  n  =  1,2. ...  A'. 

(9) 


S 

lix.y)^  AX„  S 

n  =  l 


Lxperiniciital  result 

VVc  would  now  provide  a  couple  ol  experimental  rc- 
sulls  ohiained  wilh  the  pioposed  white-light  I  ourici 
holographic  process.  In  our  experiments,  a  7S.W 
xenon  arc  lamp  with  a  I  nnn  M|natc  pinhole  is  used  as 
a  whiie-hphi  source.  A  sinussiidal  phase  prating  of  about 
1 10  lines/mm.  with  257f  diffraction  cfricicncy  for  the 
first-order  diffraction,  is  used  to  disperse  the  spectral 
content  of  the  light  source.  The  achromatic  transform 
lenses  used  are  about  750  cm  focal  length.  The  source 
encoding  mask  composes  a  set  of  periodic  circular  pin¬ 
holes  of  about  40  ;mi  and  their  spacing  is  about  2.5  mm. 
The  separation  between  the  reference  aperture  and  the 
input  target  object  is  about  8  mm.  The  size  of  the  refer¬ 
ence  aperture  is  roughly  about  300  ;jm. 

We  shall  now  show  a  couple  of  Fourier  hologram 
images  olUained  wilh  this  white-light  processing  tech¬ 
nique.  Fig.  3(a)  shows  a  gray  scale  object,  with  a  ref¬ 
erence  pinhole,  used  as  an  input  transparency.  A  broad¬ 
band  Fourier  hologram  is  generated  as  shown  in  the  en¬ 
larged  photograph  of  fig.  3(b).  Fig.  3(c)  shows  a  pair 
of  twine  holographic  images  obtained  with  this  tech¬ 
nique.  As  compared  with  the  original  object,  the  fea¬ 
ture  of  the  hologram  image  can  readily  be  seen,  al¬ 
though  the  image  quality  is  still  needed  to  improve. 

One  of  the  features  of  the  white-light  Fourier  holo¬ 
graphy  must  be  the  color  image  reconstruction.  Fig. 

4(a)  shows  a  set  of  binary  color  English  characters, 
with  a  reference  pinhole,  used  as  input  object  to  gener¬ 
ate  a  broad-band  color  Fourier  hologram.  Fig  4(b) 
shows  a  pair  of  color  holographic  images  obtained 
with  this  technique.  Although  the  image  quaint  of 
this  result  is  still  somewhat  poor,  however  as  compared 
with  the  original  transparency,  the  color  reproduction 
IS  rather  faithful.  Nevertheless,  this  result  may  be  the 
first  white-light  colour  Fourier  hologram  unage  that  is  . 
ever  reconstructed. 


-t-  Aj  [|i(jr  -e/i.y;  X„)|^  -e  U(x  -  /i,y;  X„)l^l } . 

(10) 

where  Aj  and  A2  are  proportionality  constants.  •  de¬ 
notes  the  correlation  operation.  From  this  equation 
we  see  that  two  hologram  images  of  s{x,  v)  would  be 
diffracted  around  x  -  ±ft  at  the  output  image  plane  of 
fig.  2. 


4.  Conclusion 

Wc  have  described  a  technique  of  generating  a 
broad  spectra)  band  (i.e..  white-light)  Fourier  holo 
gram.  The  technique  utilizes  light  dispersion  and 
source  sampling  method  to  obtain  a  set  of  narrow- 
band  partially  coherent  sources  for  the  hologram 
construction  process.  Since  the  technique  utilizes 
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White-light  optical  speech  spectrogram  generation 


F.  T.  S.  Yu.  T.  W.  Un.  and  K.  B.  Xu 


A  while-light  optical  processing  technique  of  generating  speech  spectrogram  is  presented.  The  speech  spec¬ 
trograms  thus  generated  are  frequency  color-coded  resulting  in  easier  visual  discrimination.  The  temporal- 
lo-spalial  conversion  of  speech  signal  is  accomplished  by  means  of  density  modulation  with  a  CRT  scanner. 
The  scaling  procedure  of  the  speech  spectrogram  as  well  as  the  frequency  resolution  limit  of  the  system  is 
discussed.  Experimental  demonstrations  of  the  proposed  frequency  color  coded  speech  spectrograms  gen¬ 
erated  by  the  proposed  white-light  optical  processing  technique  are  given. 


I.  Introduction 

Since  development  of  the  first  electronic  sound 
spectrograph  by  Bell  Telephone  Laboratories  nearly 
four  decades  ago,'  great  strides  have  been  made  in  the 
field  of  speech  analysis.  The  electronically  generated 
sound  spectrograph  has  been  widely  used  for  various 
applications  including  such  areas  as  linguistics,  pho¬ 
netics,  speech  synthesis,  and  speech  recognition. 
However,  an  optical  system  utilizing  the  Fourier 
transform  properties  of  the  positive  lens  offers  a  viable 
alternative  to  the  electronic  counterpart.  The  multi¬ 
channel  optical  processor  suggested  by  Cutrona  et  al."^ 
was  found  to  be  able  to  utilize  efficiently  the  2-D  nature 
of  an  optical  system.  Moreover,  by  sacrificing  the 
multichannel  capability  of  such  a  processor,  Thomas^ 
pointed  out  the  feasibility  of  generating  a  near  real  time 
spectrum  analysis  for  large  space-bandwidth  signal. 
Later  Yu^  reinforced  Thomas’s  concept  in  the  synthesis 
of  a  coherent  optical  sound  spectrograph.  He  pointed 
out  that  a  near  real  time  optical  sound  spectrograph  can 
be  designed  and  constructed  at  a  competitively  low 
cost.® 

In  this  paper,  we  will  describe  a  technique  of  gener¬ 
ating  multicolor  speech  spectrograms  with  a  white-light 
optical  processor.  This  technique  utilizes  a  cathode  ray 
tube  (CRTJ  scanner  density  modulator  to  convert  a 
temporal  signal  to  a  spatial  signal  that  is  suitable  for 
white-light  signal  processing.  To  obtain  a  color-coded 
speech  spectrogram,  a  dispersive  element  such  as  a 
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grating  (or  prism)  can  be  used  at  the  input  plane  of  the 
processor.  In  frequency  color  encoding,  a  narrow  slit 
is  placed  over  the  smeared  color  signal  spectra  at  the 
Fourier  plane  so  that  a  frequency  color  encoded  spec¬ 
trogram  can  be  recorded.  In  the  following,  we  shall 
describe  the  basic  performance  of  this  white-light  op¬ 
tical  spectrum  analyzer  as  applied  to  speech  signals. 
The  frequency  resolution  limit  of  the  system  as  well  as 
the  frequency  scaling  of  the  spectrogram  will  be  given. 
Experimental  demonstrations  of  the  color-coded  speech 
spectrograms,  obtained  with  the  white-light  processing 
technique,  will  be  provided. 

II.  Temporal-Spatial  Signal  Conversion 

It  is  well  known  that  an  optical  processor  is  capable 
of  performing  2-D  spatial  Fourier  transformation. 
However,  the  processing  of  time  signals  by  optical 
means  necessitates  the  transformation  of  the  signals  tq 
a  2-D  spatial  format.  Generally  speaking,  there  are  two 
ways  of  performing  this  conversion,  namely,  the  density 
and  the  area  modulation  techniques.^  Nevertheless, 
the  density  modulation  method  is  the  simplest  and  most 
commonly  used  technique  in  practice."  We  shall  use 
a  density  modulation  technique  for  temporal-to-spatial 
signal  conversion  and  also  show  that  the  temporal- 
spatial  formats  obtained  from  this  technique  are  very 
suitable  for  color-coded  spectrogram  generation  with 
a  white-light  source. 

The  conversion  can  be  obtained  by  displaying  the 
time  signal  with  a  CRT  scanner  and  then  recorded  on 
a  moving  photographic  film.  In  other  words,  the  time 
signal  is  first  applied  to  the  Z  axis  of  a  high-resolution 
CRT  scanner  to  produce  an  intensity  modulated  elec¬ 
tron  beam  so  that  the  fluorescence  light  intensity  varies 
linearly  with  the  input  signal  voltage.  Since  the  signal 
voltage  is  usually  a  bipolar  function  and  the  light  in¬ 
tensity  is  a  positive  real  quantity,  an  appropriate  bias 
should  be  added  with  the  time  signal  to  produce  a 
density  modulated  signal.  To  ensure  a  linear'density 
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mninliiin  the  iinirormily  of  sweep  intensity,  the  senn 
rale  slioiild  he  set  lonsiderahly  lii^lier  than  the  maxi¬ 
mum  (recpiency  content  or  tlie  itpnit  siKnid.  M’husthe 
siKiial  wouUNte  dis|)layed  on  tlie  (MCI’ screen  as  a  uni¬ 
form  intensity  scan  at  each  vertical  sweep.  Conse- 
(piently,  a  spatially  recordf'd  format,  whose  amplitude 
transmittance  is  linearly  |)ro()ortional  to  the  intensity 
of  (MCI'  display,  can  he  produced  hy  inia^'in^'  the  (MCI' 
display  onto  a  moving  photographic  film.  Figure  1(a) 
shows  the  schematic  diagram  of  the  conversion  process. 
M'he  recorded  format,  as  typified  in  Fig.  1(b),  can  then 
be  inserted  into  the  input  plane  of  the  optical  processor 
for  spectrogram  generation. 

In  the  time-spatial  conversion  recording,  the  speed 
of  the  recording  film  limits  the  highest-frequency  con¬ 
tent  of  the  signal  to  be  recorded.  For  example,  if  the 
‘  highest  frequency  content  of  the  signal  is  f  cps,  the 
speed  of  the  film  motion  should  be 

V  >  Ii/R,  (1) 

where  R  is  the  spatial  frequency  limit  of  the  film.  Thus 
it  is  apparent  that  to  resolve  the  highest  frequency 
content  of  the  recorded  format,  the  speed  of  the  re¬ 
cording  film  should  be  so  adjusted  higher  than  the  ratio 
of  v/R.  Unfortunately,  the  finite  optical  processing 
window  would  set  the  speed  limit  of  the  recording  film. 
A  higher  speed  of  the  recording  film  would  result  in  a 
lower  frequency  resolution  of  the  spectrogram  genera¬ 
tion,  thus  corresponding  to  a  wideband  spectrogram 
analysis.®  However,  this  drawback  may  be  alleviated 
by  utilizing  a  higher-resolution  CRT  scanner.  Never¬ 
theless,  in  practice,  a  higher-resolution  CRT  tends  to 
be  more  expensive.  Moreover,  the  frequency  resolution 
of  the  optical  processor  is  also  limited  by  the  source  size 
as  well  as  the  point  spread  function  of  the  imaging  lens 
and,  of  course,  the  width  of  the  optical  window  in  the 
processor.  Thus  the  speed  of  recording  film  should  be 
restricted  by  the  following  inequality; 


where  W  is  the  width  of  the  optical  window  of  the  pro¬ 
cessor  and  i>i  is  the  lowest  frequency  limit. 

111.  System  Analysis 

Let  us  now  discuss  n  white-light  optical  spectrum 
analyzer  as  depicted  in  Fig.  2,  where  L),  L2,  and  La  are 
achromatic  l''ouricr  transform  lenses.  If  the  recorded 
format  of  a  time-spatial  signal,  as  described  in  Sec.  11, 
is  loaded  in  a  linear  motion  film  transport  at  the  input 
plane  of  the  processor,  a  slanted  set  of  rainbow  smeared 
Fourier  spectra  in  the  Fourier  plane  can  be  observed. 
We  pole  that  the  effect  of  the  phase  grating  at  the  input 
plane  is  to  disperse  the  signal  spectra  in  a  direction 
perpendicular  to  the  recorded  input  format  (i.e.,  di¬ 
rection  of  the  film  motion),  so  that  a  set  of  nonover¬ 
lapping  slanted  (or  fan-shaped)  rainbow  color  smear 
spectra  can  be  displayed  at  the  Fourier  plane.  It  is  now 
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Fig.  1.  (a)  Temporal-to-spatial  signal  conversion.  I. « imaging  lens, 
(b)  Segment  of  recorded  format. 
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Fig.  2.  White-light  optical  sound  spectrograph.  L,  achromatic 
transform  lens. 


apparent  that,  if  a  slanted  narrow  slit  is  properly  utilized 
at  the  Fourier  plane,  as  illustrated  in  the  figure,  a  fre¬ 
quency  color-coded  spectrogram  can  he  recorded  at  the 
ouL|)Ut  plane,  with  a  moving  color  film.  'I’hc  color- 
coded  spectrographic  signal  can  al.so  be  picked  up  by  a 
color  TV  camera  for  displaying,  storage,  transmission, 
and  further  processing  hy  electronic  or  digital  system. 
We  further  note  that,  by  simply  varying  the  widtli  of  the 
input  optical  window,  one  would  expect  to  obtain  the 
so-called  wideband  and  narrowband  spectrograms.  In 
other  words,  if  a  broader  optical  window  is  utilized  for 
the  spectrogram  generation,  a  high  spectral  resolution, 
corresponding  to  a  narrowband  spectrogram,  can  be 
obtained. 
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loss  orspcdral  rcsoliilion  is  ox|iocl(‘d.  However,  loss 
ol  I  lie  speel  nil  resoltd  ion  iiii|irov(‘s  I  lie  I  iiiie  resoliil  ion 
of  III!' speelroi’nnii.  'I'liis  lime  liinidwidlli  n'lationsliip 
is  in  lael^llie  eonsetpienee  ol  Llie  I  leisenberti'H  uncer¬ 
tainty  relation  in  quantum  mechanics.^ 

I'or  simplieily  in  analysis,  we  lei  the  licht  source  he 
a  square  white-littht  source.  The  source  irrndiance  may 
be  written  as 

7(j:n..Vi,;X)  =  .S(X)  red  |-^|  red  |^|  •  (3) 

where  S(X)  is  the  spectral  distribution  of  the  light 
source,  6  denotes  the  size  of  the  square  source,  and 

redW=  ‘•1^1 

\bl  0.  otherwise. 

With  reference  to  Wolf  s  partial  coherence  theory'®  the 
mutual  coherence  function  at  the  input  plane  Pi  of  the 
spectrum  analyzer  of  Fig.  2  would  be 

r(xi,Vi;jr20'2;X)  =  JJ^Ixo.yolX) 

.2rr  , 

•  exp  -1  (xo(xi  -  xj) 

+  yoCVi  -  yjllj  dxodyo,  (4) 


where  the  integration  is  over  the  source  irradiance.  By 
carrying  out  the  integration,  the  mutual  coherence 
function  at  plane  Pi  becomes 


r(xi.yr.X2,y2;X)  =  KS(X)  sine 


irbixi  -  X2) 


I  X/ 

Trbl.vi  -  yj) 

X/ 


where 


sinc(irx) 


^  sinlrrx) 


and  K  is  an  appropriate  constant. 

Now,  if  the  time-spatial  signal  format  is  inserted  at 
the  input  plane  P\  of  the  processor,  the  mutual  coher¬ 
ence  function  behind  the  input  plane  would  be 

r'(xi,xi;x2,>2;X)  =  r(xi,yi,X2,>'2:X)  exp(K/o(yi  -  .Vsll 


lliclicc.  Mild  (/),(/ 1  i'4  the  Miii'.ilhir  MpMlinl  liriillciii'V 
coordiiwile  svsiem  which  i  iiii  he  wrillen  ms  p  *.  2ni</f\. 
1 1  —  ',’.11 1 1//  S,  mid  ( 1 1  ,/l)  in  I  lie  npiil  iiil  1  1  n  il  il  mill  m  nvni  eiii 

ol  I  he  Fourier  phine  Z'^. 

By  propi'rly  siihsliliiliiig  h'q.  Hi)  inlo  F(|  (71  Miid  in- 
Icgnil  iiig  ov(‘r  Iheyi  mikI  \  .,j  voriMhles.  we  luive 


•  r(ii)f»(x2)  red  I  red  •  (61 

where  the  exponential  factor  represents  the  phase 
tr.nnsform  of  the  l-D  phase  grating,  r/n  is  the  angular 
spatial  frequency  ol  the  grating,  l(x )  is  the  amplitude 
transmittance  function  of  the  recorded  format,  and  M' 
is  the  width  of  the  input  optical  window  as  shown  in  the 
figure.  Thus  it  is  apparent  that  the  mutual  coherence 
function  arriving  at  the  Fourier  plane  P2  would  be 

ripi,gi;p2.<)2;X)  =  .f.f.f.rr'ii  i;x2.'2;X) 

•  exp|-i(x  iPi  +  ViCi  -  X2P2  -  .V2g2)l 
■  dx  td\  tdx'jdyj.  (7l 

where  the  proportional  constant  is  ignored  for  conve- 


I'ipi.gi;p2.g2;X)  =  .s'lXi  red 


X/  —  +  —  -  gi 


■  Xlgi  -  (Jj\ 


i  X  j) 

•  JJ  Hinc  - 


•  reel  —  reel  — 

\wj  iw'i 

•exp\-~iix]p]  —  X2P2)Wxi(ix2  <8) 

For  simplicity  of  illustration,  we  assume  that  the 
input  format  is  a  single  sinusoidal  signal,  i.e., 

f(x)  =  1  +  cos(p(Vr)  for  all  >  .  (9) 

where  pn  is  the  spatial  frequency  of  the  sinusoid.  Since 
the  cosine  function  of  Eq.  (9)  can  be  written  into  two 
exponential  functions,  we  focus  pur  attention  merely  to 
one  of  the  diffraction  order,  that  is, 

((xi)l*(X2)  =  exp|ip(i(xi  -  X2)|  (10) 

By  substituting  Eq.  (10)  into  Eq.  (8),  we  obtain 


r(pi,gi:p2,g2;X)  «  SIX)  red 


X/.^  +  !^-go 

l2  2  , 


•6lgi-  92) 


■  JJ  sine  ^  explipoixi  -  12)] 

X/ 

•  red  1^1  red  |^|  exp|-i(xipi  -  x2P2)ldx,di2. 


Since  the  interest  is  centered  at  the  output  irradiance, 
by  letting  p\  =  P2-  P  and  Qi  =  (?2  =  Q-  the  irradiance 
at  the  Fourier  plane  would  be 

/(p,9;X)  =  SIX)  red  /(p),  (12) 

2Trh 


where 


lip)  -  .[f  sine 


[x-6(x  1  -  X2)l 


exp|ipo(xi  -  xj) 


•  rprt  rrc-I  |  rxitl  — i  ( j  i  —  x-i)p\*i x \flx -j.  ( I  'U 

To  investigate  the  variation  of  the  output  irradiance 
due  to  the  width  of  the  input  optical  window.  Fig.  .3 
shows  a  plot  of  the  normalized  intensity  variation  of  Eq. 
(13)  for  two  values  of  U'.  From  this  figure  we  see  that 
a  narrower  spread  of  output  irrndiance  corresponds  to 
a  broader  optical  window  W  at  the  input  jilane.  Thus 
a  narrowband  spectrogram  can  be  generated  in  this 
manner.  On  the  contrary,  if  a  narrower  optical  window 
is  utilized,  a  broader  spread  of  the  output  irradiance  is 
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Fig.  3.  Normal>7ed  nutpui  spectral  distribution  as  a  function  of  input 
frequency  for  two  sizes  of  optical  windows. 


expected.  Thus  a  wideband  spectrogram  may  be  gen- 
.eraled  with  a  narrow  optical  window. 

To  have  a  better  understanding  of  Eq.  (12),  two  ex¬ 
treme  cases  of  the  light  source  will  be  discussed  in  the 
following: 

(a)  If  we  assume  that  the  broadband  light  source  is 
vanishingly  small  (i.e.,  b  —  0),  then 

,,  t6(ii-X2) 

lim  sine  - ; -  =  1. 

s— 0  X/ 

and  Eq.  (12)  takes  the  form 

/(p.fliX)  =  S(X)  rect  sinc^|irW(p  -  po)l. 

2x0 


This  result  describes  a  completely  spatially  coherent 
illumination. 

(b)  On  the  other  hand,  if  the  light  source  becomes 
infinitely  large  (i.e.,  6  —  <»),  then 

,,  x6(x,-12) 

lim  sine  -  =Kd(xi-X2l. 

s-o  X/ 

where  K  is  an  appropriate  constant,  and  Eq.  (12)  be- 


/(p,p;X)  =  S(X)  reel  (15) 

2Th 

This  result  corresponds  to  a  completely  spatially  inco¬ 
herent  illumination.  Nevertheless,  the  proposed 
white-light  spectrum  analyzer,  as  can  be  seen,  is  oper¬ 
ating  in  a  partially  coherent  mode. 

IV.  Frequency  Calibration  and  Resolution 

We  shall  now  discuss  the  frequency  calibration  of  the 
proposed  white-light  optical  speech  spectrogram.  The 
accuracy  of  the  frequency  measurement  depends  on  the 
width  of  the  input  optical  window  as  well  as  the  width 
of  the  sampling  slit  at  the  Fourier  plane.  By  adjusting 
'these  parameters,  a  properly  calibrated  speech  spec¬ 
trogram  can  be  generated  at  the  output  plane. 

Let  us  assume  that  the  transform  lenses  are  achro¬ 
matic  (i.e..df/dX  =  0)  and  the  angular  spatial  frequency 
of  the  input  phase  grating  is  qn.  Thus  we  see  that  the 


Fourier  spectrum  ol  the  phase  grating  would  be  dil- 
fracted  at 

fi  =  iKjnnUi,,.  (Mil 

where  f  is  I  he  local  lengl  h  o(  I  he  aheromat  ic  ( raiwlorm 
lens.  .Since  I'lq.  (Hi)  is  linearly  proportional  to  the 
wavelength  of  the  light  source,  a  rainbow  color  of 
smeared  spectra  can  be  observed  along  the  /f  axis  in  tlie 
Fourier  (ilane  /L.  For  simplicity,  we  assume  that  input 
format  is  a  single  sinusoid  of  spatial  frequency  po;  then 
the  Fourier  spectra  points  are  located  at 

xf  • 

it  -  ±  —  Po-  ( 1  <  I 

27r 

For  convenience,  we  use  the  positive  value  of  Eq.  (17) 
in  our  discussion.  By  taking  the  ratio  of  Eqs.  (16)  and 
(17),  we  have 

a  «=  — (18) 


where  we  assume  that  pn  «  Qo,  and  qp  is  the  spatial 
.frequency  of  the  phase  grating.  Thus  we  see  that  the 
frequency  locus  of  the  input  signal  can  be  properly 
traced  out  in  the  Fourier  plane.  In  view  of  Eqs.  (16)  and 
(17),  and  the  fact  that  qp  »  pp,  we  further  see  that  the 
spectrum  of  the  input  signal  would  disperse  into  a 
rainbow  color  at  a  slanted  angle  in  the  Fourier  plane.  It 
is.  therefore,  apparent  that,  if  a  narrow  masking  slit  is 
properly  utilized  in  the  Fourier  plane,  a  frequency 
color-coded  spectrogram  can  be  obtained  at  the  output 
plane. 

Now  let  us  suppose  that  the  masking  slit  can  be  de¬ 
scribed  as 

^  =  — Qo  +  rt  lany,  '  (19) 

2r 

where  Xo  denotes  the  upper  or  lower  limit  of  the  source 
wavelength  depending  on  the  slit  orientation,  and  tany 
is  the  slope  of  the  slit.  By  substituting  Eqs.  (16)  and 
(17)  into  Eq.  (19),  we  have 

Qp)  X  —  Xp) 

PC  =  — - • 

A  lari') 

which  can  be  written  as 

Pol’  QoIX-Anli' 

V  = -  = -  .  1201 

2x  2xX  Ian") 

where  e  is  the  time  frequency  of  the  input  signal.  Thus 
we  see  that  the  temporal  frequency  of  the  input  signal 
and  the  spectral  wavelength  of  the  light  source  form  a 
nonlinear  function,  as  plotted  in  Fig.  4(a).  Figure  4(h) 
shows  the  experimental  result  to  confirm  this  rel.a- 
tionship.  Nevertheless  this  nonlinearity  of  fre¬ 
quency-spectral  wavelength  relationship  can  be  lin¬ 
earized  by  using  an  approfiriate  curve  slit  instead  of  a 
linear  one  in  the  Fourier  plane. 

We  shall  now  discuss  the  frequency  resolution  of  the 
proposed  system.  We  note  that  the  frequency  resolu¬ 
tion  is  primarily  limited  by  the  width  of  the  input  op¬ 
tical  window,  the  source  size,  and  the  width  of  the 
sampling  slit  in  the  Fourier  plane.  To  investigate  these 
effects,  we  assume  that  the  size  of  the  white-light  source 
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WAVELENGTH  (NM) 

(b) 

Fig.  4.  Variation  of  input  frequency  vs  spectral  wavelength  of  the 
light  source:  (a)  calculated  result;  (b)  experimental  result 

is  b.  Then  the  size  of  a  point  spread  image  would  be 


where  /'  and  /  are  the  focal  lengths  of  collimating  and 
achromatic  Fourier  transform  lenses,  respectively. 
Thus  the  width  of  the  point  spread  image  at  the  spatial 
frequency  plane  would  be 

b'  bv 

=  (22) 

Since  the  width  of  input  optical  window  affects  the 
spectral  resolution  of  the  processor,  the  width  of  the 
spectral  lines  in  hertz  for  a  point  source  is 

Avj  «  u/W,  (23) 

where  v  is  the  speed  of  the  film  motion,  and  W  is  the 
width  of  the  input  optical  window. 

For  simplicity,  we  shall  treat  these  two  factors  (i.e., 
source  size  and  width  of  optical  window)  independently. 
It  is  apparent  that  the  spread  of  the  smeared  spectral 
line  (i.e.,  frequency  resolution)  of  the  system  can  be 
approximated  by  the  following  equation: 

^  Av  “  IIAvP^  +  (Aj'2)’1'^2  -  u  jl-^l  +  |“|  ■  <24) 

As  an  example,  if  we  let  t'  =  195  mm/sec,  5  =  90  Mm,  A 
=  0..5.5  Mm,  W  =  35  mm,  and  /'  =  762  mm,  the  frequency 
spread  of  the  proposed  optical  spectrum  analyzer  is  Ai' 
=  42  Hz,  which  corresponds  to  a  narrowband  analysis 

• 
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Fig.  6.  Determination  of  the  output  spectral  resolution. 

(o.g.,  niirrowlmnd  speech  spectrogrtitn).  Ihiwever,  we 
see  that  the  overall  output  resolution  of  the  spectral 
spread  is  determined  by  the  width  and  orientation  of  the 
sampli.ng  slit  at  the  Fourier  plane,  as  illustrated  in  Fig. 
5.  Thus  the  effective  output  frequency  resolution  can 
be  shown  as 

Ivv  w,  1 

- - —  + -  ■  (2.S) 

sinlT  -  <A)  tan(7  -  *)) 

where  W,,  and  W,  are  the  width  of  the  smeared  fre¬ 
quency  spectral  line  and  the  width  of  the  sampling  slit, 
f  is  an  appropriate  conversion  factor,  and  7  and  tp  are 
defined  in  the  figure. 

From  this  equation  we  see  that  the  effective  output 
frequency  resolution  is  proportional  to  the  diagonal 
region  of  the  spectral  line  that  intersects  the  sampling 
slit,  as  shown  in  the  shaded  area.  Therefore,  the  overall 
output  frequency  resolution  is  somewhat  lower  than  the 
width  of  the  smeared  spectral  line,  i.e., 

Ai/,  i  Av.  (26) 

This  is  the  price  of  the  color  encoding.  Nevertheless 
the  price  we  paid  is  considered  small  compared  with  the 
advantages  we  gained  from  the  white-light  pro¬ 
cessing. 

V.  Experimental  Demonstrations 

In  our  experiments,  a  75-W  xenon  arc  lamp  with  a 
90-Mm  pinhole  was  used  as  a  white-light  source.  A 
phase  grating  of  80  lines/mm  was  used  as  a  dispersive 
element  at  the  input  plane.  A  narrow  slit  of  ~70  Mm  is 
inserted  in  the  Fourier  plane  for  color  encoding.  The 
focal  length  of  the  achromatic  transform  lens  was  ~350 
mm. 

In  the  experimental  demonstration,  we  show  two  sets 
of  color-coded  speech  spectrograms  obtained  with  this 
technique,  as  depicted  in  Figs.  6  and  7.  The  frequency 
contents  of  these  spectrograms  are  encoded  in  rainbow 
color  from  red  to  blue  for  upper  to  lower  frequencies. 
These  spectrograms  were  produced  by  a  sequence  of 
English  words,  testing,  one,  two,  three,  four,  spoken  by 
a  male  and  a  female  voice,  respectively.  Figure  6  shows 
a  set  of  narrowband  speech  spectrograms  representing 
a  45-Hz  bandwidth  resolution.  Figure  7  illustrates  a  set 
of  wideband  speech  spectrograms  with  a  300-Hz 
bandwidth  analysis.  From  these  sets  of  spectrograms, 
we  see  that  the  basic  structure  of  the  spectrograph ic 
contents  is  preserved.  The  characterization  of  the 
formant  variation  can  readily  he  identified.  Since  Fig. 
6(a)  is  produced  by  a  low-pitched  voice  (i.e.,  male),  the 
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Fig.  6.  Black-and-white  photographs  of  narrowband  color -coded 
speech  spectrograms  (~45-Hz  bandwidth):  (a)  obtained  with  a  male 
voice;  (b)  obtained  with  a  female  voice. 


time  (SEC) 

(a) 


n|M<<'lri)F.ritiiin  ol  I'  i)!.  7  iin<  riiiiiililt'  o(  rpMulvinK  I  he  liiii)' 
reHolulion,  l)ut  it  fails  to  resolve  the  speclral  liiicw.  We 
Hole  t  hnl  I  lie  I  rndini/  of  I  line  null  rrei|iienrv  rent  do  I  ioiia 
Iwtweeii  the  wide  and  narrow  N|H-('tro|'raniH  is  cssi-nl  tally 
the  well-known  Ai’Al  eoneeiit  in  Ihe  coininiinical ion 
llnairy  (i.e.,  Ai'Al  >  I ),  wliieli  is  relaled  lo  the  liiinons 
HeisenherR's  uncertainty  itrinciple"  in  quantum  me- 
eliiinieM. 

VI.  Conclusion 

In  this  paper,  we  have  presented  a  method  of  gener- 
ating  a  continuous  frequency  color-coded  speech  sfiec- 
trogram  with  a  white-light  processing  technioque.  The 
proposed  system  not  only  offers  a  low-cost  alternative 
but  also  eliminates  the  coherent  artifact  noise.  More¬ 
over,  the  multicolor  display  of  the  spectrogram  is 
adapted  to  the  natural  sensitivity  of  human  eyes  and 
thereby  provides  improved  visual  discrimination. 
Nevertheless,  we  want  to  stress  that  due  to  the  very 
limited  resolution  of  the  CRT  scanner  used  in  our  ex¬ 
periments,  the  results  that  we  obtained  only  extended 
to  1.6  kHz.  This  limitation  is  more  pronounced  for  a 
wideband  spectrographic  analysis,  which  is  primarily 
due  to  low-light  performance  of  narrower  optical  win¬ 
dow  used  at  the  object  plane.  However,  to  our  experi¬ 
ence,  if  a  higher-resolution  CRT  scanner  is  utilized,  the 
frequency  range  can  easily  push  up  to  4  kHz.  This 
frequency  range  is  commonly  used  for  most  telephonic 
systems. 


time  (SEC) 

ro) 

Fig.  7.  Black-and-white  pictures  of  wideband  color-coded  speech 
spectrograms  (~.300-'Hz  bandwidth):  (a)  generated  by  a  male  voice; 
(b)  generated  by  a  female  voice. 


spectrogram  shows  more  abundant  harmonica  as  com¬ 
pared  with  the  hiRh-pitcheri  voice  in  Fig.  6(1)). 

It  is  worthwhile  to  mention  that  although  the  nar¬ 
rowband  spectrogram  is  capable  of  resolving  the  spec¬ 
tral  contents  of  a  speech,  it  loses  the  time  striation,  as 
can  be  seen  in  Fig.  6.  On  the  other  hand,  the  wideband 
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PROGRESS  REPORT  ON  ARCHIVAL  STORAGE 

OF  COLOR  FILMS  UTILIZING 
A  WHITE-LIGHT  PROCESSING  TECHNIQUE 

F.  T,  S.  YU.  X.  X.  CHEN  and  S.  L.  ZHUANG 


Mots  n.rs  ; 

Traitement  d'image 
Ccxlagc  couleur 
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Image  processing 
Color  encoding 


SUMMARY  :  In  this  paper,  we  report  a  spatially  encoding  techni¬ 
que  such  that  the  moire  fringe  pattern  inherently  existing  with  the 
retrieved  image  can  be  avoided.  To  improve  the  diffraction  efTi- 
ctency  of  the  film,  we  have  introduced  a  bleaching  process  so  that 
the  step  of  obtaining  a  positive  encoded  transparency  can  be 
eliminated.  Instead  of  restricting  the  encoding  processing  in  the 
linear  region  of  the  T-£  curve,  we  would  allow  the  encoding  in  the 
linear  region  of  the  D-E  curve,  so  that  a  broader  range  of  encoding 
exposure  can  be  utilized.  Experimental  results  indicate  that  excellent 
color  ndeiity.  high  signal  to  noise  ratio,  and  good  resolution  of  the 
reproduced  color  images  can  be  obtained. 


Amelioration  d'une  technique  de  traitement 
en  lumiere  blanche  pour  Parchivage  de  films  en  couleurs 

r6SUM6  ;  Dans  cet  article  nous  decrivons  une  technique  de 
codage  spatial  qui  evite  les  elTets  de  moire  dans  fimage  restituee. 
Pour  ameliorer  I'elficacite  du  reseau  de  diffraction  forme  par  le 
film,  nous  avons  introduit  une  technique  de  blanchiment  qui 
elimine  le  tirage  d'un  positif.  Au  lieu  de  restremdre  Ic  codage  dans  la 
partie  linraire  de  la  courbe  transmission-eclairement.  il  est  possible 
de  coder  sur  la  partie  linuire  de  la  courbe  elTicacile  de  diffraction- 
eclairement.  ce  qui  elargit  la  gamme  d'expositions.  Les  resultats 
experimentaux  montrent  une  excellente  fidcliie  des  couleurs.  un 
grand  rapport  signal  sur  bruit  et  une  bonne  resolution  dans  la 
restitution  des  images  en  couleurs. 


INTRODUCTION 

Archival  storage  of  color  films  has  long  been  an 
unresolved  problem  for  the  film  industry.  The  major 
reason  is  that  the  organic  dyes  used  in  color  films  are 
usually  unstable  under  prolonged  storage,  often 
causing  gitidtitil  coltu  lading.  Altluiugh  there  are 
several  available  techniques  for  preserving  the  color 
images,  all  of  them  possess  certain  definite  draw¬ 
backs.  One  of  the  most  commonly  used  techniques 
involves  repetitive  application  of  primary  color  fillers, 
so  Jlhal  the  color  images  can  be  preserved,  in  three 
separate  rolls  of  black-and-white  film.  To  retrieve 
the  color  image,  a  system  with  three  primary  color 
projectors  are  used.  These  films  should  be  projected 
in  perfect  unison  so  that  the  primary  color  images 
will  be  precisely  recorded  on  a  fresh  roll  of  color  film. 
However,  this  technique  has  two  major  drawbacks  : 
first,  the  storage'  volume  for  each  film  is  tripled.  Second, 
the  reproduction  system  is  rather  elaborate  and 
expensive. 

The  use  of  monochrome  transparencies  to  retrieve 


color  images  was  first  reported  by  Ives  (1]  in  1906. 
He  introduced  a  slide  viewer  that  produced  color 
images  by  a  diffraction  phenomenon.  Grating  either 
of  dilfcrcnl  spatial  frequencies  or  of  azimuthal  orienta¬ 
tions  were  used.  More  recently,  Mueller  [2]  described 
a  similar  Icchniquc,  employing  a  tricolor  grid  screen 
for  image  encoding.  In  decoding,  he  used  three  quasi- 
monochromatic  sources  for  color  image  retrieval. 
Since  then,  similar  work  on  color  image  retrieval 
has  been  reported  by  Macovski  [3],  Grousson  and 
Kinany  [4],  and  Yu  [5).  However,  those  techniques 
suffer  a  major  drawback ;  namely,  the  moire  fringes 
in  the  retrieval  color  image  will  not  be  avoided. 

We  will,  in  this  paper,  report  a  spatially  encoding 
and  decoding  process  such  that  the  moire  fringe 
pattern  can  be  avoided  by  spatial  filtering.  To  improve 
the  diffraction  efficiency,  we  have  introduced  a 
bleaching  processing  for  the  encoded  film  in  which 
the  step  of  generating  a  positive  transparency  can  be 
eliminated  We  have  also  experimentally  demonstrated 
that  the  spatially  encoding  process  should  not  be 
restricted  to  the  linear  region  of  the  H-D  curve. 
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InsfciKl,  it  is  iccoiiiiDOiiilcil  to  cituulc  in  the  liiiciii 
ll‘^•ill||  ol  Hu*  (lilliMi'liiHi  i*llu  iciit'v  ii  rsiis  c*x|hisiii(‘ 
curve  (called  /)-/■,  curve).  Detail  ex|X'riiuental  pu>- 
eeilure  of  this  archival  sturiipe  lcehnic)ue  is  prescnlerl. 
I’icliiniMary  results  ol  retrieval  color  iitiages  are 
provided.  Comparisons  with  original  color  irans- 
parcttcy  are  also  givcti. 


SI*AMAL  ENCODING  AND  DECODING 


Wc  shall  now  describe  a  spatial  encoding  technique 
utilizing  a  white-light  source.  A  color  transparency 
is  used  as  an  object  to  be  encoded,  by  sequentially 
exposing  with  primary  color  of  lights,  onto  a  black- 
and-white  film,  as  illustrated  in  //[^ure  J.  The  encoding 
is  taken  place  by  spatial  sampling ;  the  primary  color 
images  of  the  color  transparency,  with  a  specific 
sampling  frequency  and  a  predescribed  direction  onto 
a  monochrome  film.  In  order  to  avoid  the  moire  fringe 
pattern  in  the  retrieval  color  image,  we  propose  to 
sample  one  of  the  primary  color  imtigcs  in  one  inde¬ 
pendent  spatial  coordinate,  and  the  remaining  two 
primary  color  images  in  the  other  independent  spatial 
coordinate,  as  shown  in  figure  2.  Since  any  mixture 
of  red  with  green  or  with  blue  colors  produces  a  wide 
ningc  of  intermediate  colons,  wc  propose  to  encode 
the  red  color  image  in  one  independent  spatial  coor¬ 
dinate  direction,  and  the  blue  and  green  color  images 
in  the  other  remaining  independent  coordinate  direc¬ 
tion.  Thus  a  small  amount  of  color  spread  (i.e.,  color 
crosstalk)  from  blue  to  green  (but  not  from  green  to 
blue)  may  not  be  avoided.  However  this  small  amount 
of  color  spread  will  not  cause  significant  adversed 
effect  in  the  retrieved  color  image,  for  primarily  two 
reasons  ;  first,  a  slight  mixture  of  blue  into  green 
will  not  produce  significant  color  changes.  Second, 
strictly  speaking  all  the  color  transparencies  are  not 
natural  colors,  thus  a  small  amount  of  color  deviation 
would  not  be  noticeable  by  human  perception. 
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FiCi.  2.—  Positions  ol  the  three  spatial  samplmi;s 


We  shall  now  demonstrate  that  the  moire  fringes 
can  be  avoided  with  the  proposed  encoding-decoding 
technique.  Let  this  intensity  transmittance  of  the 
encoded  films  be  [5] 


T,(x.  >')  =  K  {  T,(x.y)(I  +  sgn  (cos  p,  y)]  + 

+  7'i,<^.>’)(l  -F  sgn  (cos  x)]  (I) 
+  7',(x,>-)|l  -F  sgn(cosp,  x)]  }"L 


where  T„{x,  y)  is  the  encoded  black-and-white  negative 
transparency,  K  is  an  appropriate  proportionality 
constant.  T,.  and  T,  are  the  red.  blue,  and  green 
color  image  exposures,  p,.  p^.  and  p,  are  the  respective 
carrier  spatial  frequencies,  (x.  v)  is  the  spatial  frequency 
coordinate  system  of  the  encoded  film,  y  is  the  film 
gamma  [6],  and 


sgn  (cos  x)  ^ 


1.  cos  X  ^  0, 
—  1.  cos  X  <  0  . 


Instead  of  obtained  a  positive  image  transparency, 
through  a  contact  printing  process  of  Eq.  (2)  as 
proposed  in  a  previous  paper  [5],  we  shall  bleach  the 
encoded  negative-image  film  to  obtain  a  phase  object 
transparency  [7.  8].  Let  us  assume  that  the  bleached 
transparency  is  encoded  in  the  linear  region  of  the 
diffraction  efficiency  D  versus  exposure  £  (e.g..  as 
shown  in  //g.  6).  The  amplitude  transmittance  of  the 
bleached  transparency  can  be  written 


i(x,  jj  =  CXp[/(/)(X.  )  )J  . 


where  (/)(.\.  y)  represents  the  phase  delay  distribution, 
which  is  proportional  to  the  exposure  of  the  encoded 
film  [9],  such  as 


(/)(.\.  j  )  =  M  {  T,(.\. .)  j  (1  +  sgn  (cos  /\  I')]  -F 

+  T ^(x.  j  )  1 1  -F  sgn  (cos  Pfc  x)]  (4) 


+  T,(.x.  y)  1 1  -F  sgn  (cos  p,  .x)] 


where  M  is  an  appropriate  proportionality  constant. 
If  we  place  this  bleached  encoded  film  at  the  input 
plane  P,  of  a  white-light  optical  processor,  as  illus¬ 
trated  in  lifinrc  3.  then  the  complex  light  distribution 
due  to  f(.x.  y),  for  every  at  the  spatial  frequency 
plane  can  be  determined  by  the  following  Fourier 
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By  expanding  M.x.  v)  into  cxptincniial  series,  Eq.  (5)  can  be  wriltcn 


S(a. /<;/)  =  1^1+  /</>(.x.  y)  +  2  I- ^  '■  r 


-  +  lh‘) 


d.v  d  1  . 


(6) 


By  subsliluling  Eq.  (4)  into  Eq.  (6)  and  retaining  the  first-order  and  the  first-order  convolution  terms  we  have 


// 


S  (a.  /} ;  k)  =  T,(  a,  /I  ±  )  +  T,(  a  p 


M 


2ti‘ 


+  T„(  “  ±  P]+f, 


{<^P±^Pr 


•  Pi"  P 


(7) 


F  Ki.  X  lifihi  processor  for  spatial  color  decftJitif:.  I,  extended 

white  light  source  ;  L,  transform  lens  :  T{x,  y),  bleached  encoded 
transparency. 


a 


where  T,.  7\  and  T,  are  the  Fourier  transforms  of  T„ 
and  T,  respectively.  *  denotes  the  convolution 
operation,  and  the  proportional  constants  have  been 
neglected  for  simplicity.  We  note  th;it.  the  last  cniss 
product  term  o(  Eq.  (7)  would  introduce  a  moire 
fringe  pattern,  parallel  to  encoding  gratings  of  blue 
and  green,  in  the  retrieved  color  image.  Nevertheless, 
all  of  those  cross  product  terms  can  be  properly 
mtiskcd  out  ;it  the  Fourier  plane.  Thus  by  proper  color 
filtering  those*  first-order  smeared  Fourier  spectra, 
as  shown  in  fifnire  4.  a  moire  free  true  color  image 
Ciin  be  retrieved  at  the  output  image  plane  F,.  The 
corresponding  complex  light  field  immediately  behind 


the  Fourier  plane  would  be 
S(a.  P)  =  p  - 

+  ^'f(“  -  ^Pi"  P')  +  P) 

where  A,.  and  arc  the  respective  red.  blue,  and 
green  color  wavelengths  At  the  output  image  plane, 
the  complex  light  distribution  is 

5(.x.  >’)  =  T,(x.  y)  expt/ip,)  -i-  T^(.\.  y)  expl/vp^)  -1- 

-t-  T,(  \.  r)  cxp(  -  ixpj  .  (»}) 


T 
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IJic  oiupul  iiiiugc  iriiidiancc  is  llicrdorc 

l{\.y)  I  7,;(\.r)  l  (H>) 


wliich  is  11  siipi’iposilion  oC  lliicc  piiniiiry  ciiuxtccl 
color  iiniittcs.  I  lius  wc  see  llial  a  moire*  Ircc  color 
iiTiii}>c  can  indeed  be  obtained. 

We  siiall  now  ilisenss  llie  elVeel  ol  nuiire  iVintie 
pattern  in  more  diail.  It  is  well  known  that  a  moire 
pattern  is  produced  by  the  overlaying  ol  two  or  m»»re 
gratings  (10.  11].  When  two  gratings  of  spacing  a  and  h 
arc  superimposed  with  ;in  obliquity  angle  of  0,  the 
moire  fringe  spacing  d  can  be  written  as  : 

(11) 

—  2  ah  cos  0 

and  this  slope  of  the  moire  fringe  is 


tan  (j)  = 


h  sin  0 
a  -  bcos  O' 


(12) 


where  h  is  the  index  of  moire  pattern  (/i  =  0,  +  1, 
±  2. ...)  which  represents  the  resultant  moire  fringes 
as  an  indexed  family  of  curves  (see  ref  11).  If  these 
two  gratings  are  perpendicularly  superimposed  at  an 
angle  0  =  90".  then  they  form  a  cross  grating  pattern, 
without  moire  fringes  (llj. 

On  the  other  hand,  if  two  gratings  are  parallel- 
superimposed  on  the  top  of  the  other  (i.e.,  0  =  0"), 
than  a  beating  frequency  parallel  to  those  gratings 
would  occur.  The  corresponding  fringe  spacing  is 


d  = 


hah 

\a  -  b\' 


(13) 


and  the  relevant  (i.e.,  moire)  spatial  frequency  is 

=  \Pa  -  Ph\<  (14) 

where  =  2  n/a  and  Pi,  =  2  n/b  are  the  spatial 
frequencies  of  the  two  gratings. 

We  shall  now  investigate  the  moire  fringe  effects 
due  the  spatial  encoding  of  figure  2.  Since  grating 
no.  3  is  perpendicularly  superimposed  with  grating 


nos.  I  and  2.  il  will  not  generate  any  undesirable  moire 
fringes  except  a  cross  grid  beiween  gratings  ^  anri  1. 
and  .1  aiul  2.  Wlieicas  gratings  I  anil  2  arc  parallel- 
superimposed.  it  produces  a  moire  fringe  pattern  of 
spatial  lret|uency /)„,  -  \  p^  —  /),  |  in  the  same  direction 
ol  gratings  1  and  2 

Since  the  last  term  of  fiq.  (7)  represents  the  l  ourier 
transform  of  this  moire  fringe  pattern,  the  resolution 
ol  the  retrieved  encoded  color  image  (blue  or  green) 
is  limited  by  the  size  of  the  color  spatial  filters,  as 
illustrated  in  figure  4.  Therefore,  the  spatial  frequency 
requirements  ol  the  gratings  I  and  2  can  be  determined 
by  the  following  equation 

r,  =  ^(/’,  +  2/7*)  =  (15) 

The  resolution  limit  of  retrieved  color  image  is 

P  ^\P,-  Pt,\  =  \pt,<  (16) 

and  the  spatial  frequency  of  the  moire  fringe  pattern  is 

Pm=\P,-  Pt,\  =  \pt,-  (12) 

Thus,  by  proper  selection  of  desirable  grating  fre¬ 
quencies.  which  depends  upon  the  resolution  limit 
of  the  object  transparency,  the  spatial  frequency 
content  of  the  moire  pattern  can  be  determined.  With 
appropriate  color  filtering,  the  encoded  Fourier 
spectra  as  illustrated  in  figure  4,  a  moire  free  color 
image  can  be  obtained. 


EXPERIMENTAL  DEMONSTRATION 

In  our  experiment,  we  utilized  three  Kodak  primary 
color  filters  of  No.  25.  47B  and  58  for  the  encoding 
and  decoding  process.  The  characterizations  of  these 
filters,  illuminated  by  standard  A  illuminant  (12.  13). 
are  specified  by  the  C.l.E.  diagram,  as  shown  in 
figure  5.  The  corresponding  trichromatic  coefficients 
of  these  filters  are  tabulated  in  the  following  : 


No.  25  -  R* 

;.  =  6  1 50  A 

=  0.680 

y*  =  0.320 

z*  =  0 

No.  58  -  (;• 

;.  =  5  5tK)  A 

X,  =  0..302 

y„  =  0.692 

=  O.(Klt) 

N0.47B  -  B* 

W* 

;.  =  4  3(K)  A 

x„  =  0.169 
x„.  =  0.448 

y„  =  0.(K)7 
>H-  =  0.408 

z„  =  0.824 
z„.  =  0.144 

where  R*.C*.  B*  and  denote  the  red.  green,  blue 
and  white  colors,  respectively,  x  +  y  -i-  r  =  1.  and 
X.  y.  and  r  arc  the  trichromatic  coefficients  obtained 
from  the  chromaticity  coordinates  of  the  C.l.E. 
chromalicity  diagram  (12.  1.3).  Grating  frequency  of 
40  lincs/mrti  is  used  for  red  and  green  color  image 
encodings,  and  grating  frequency  of  26.7  lines/mm  is 
used  for  blue  color  image  encoding.  A  xenon  arc  lamp 
is  used  for  the  white-light  processing,  and  the  color 


decoding  filters  are  the  same  type  of  color  filters  used 
for  the  encoding.  The  trichromatic  coefficients  arc 
expected  to  be  the  same  as  those  in  Eq.  (18).  except 
for  the  white  color,  that  is 

H7  :  Xh  =  0.310.  y„.  =  0.316.  =  0.374  .  (19) 

We  shall  now  illustrate  that  any  choice  of  color  can 
be  reproduced  by  a  simple  transformation  from  C.l.E. 
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Fig.  5.  —  Chromaiicity  coordiruiies  in  C.I.E. 


lo  R*  G*  B*  as  described  in  the  following  equation 
[14.15]. 

R  =  K^  X  +  K^Y  +  K^Z, 

G  =  K4  A"  +  Kj  y  +  K^Z,  (20) 

and  B  =  K,X  +  KgY  +  KgZ, 

where  R.  G,  and  B  are  the  red.  green,  and  blue  color 
tristimulus  values,  and  A',  and  Z  are  the  C.I.E. 
tristimulus  values,  and  the  K's  are  arbitrary  constants. 
We  note  that  these  tristimulus  values  can  be  expressed 
as  [14,  15]  : 


A 

X,; 

y 

Ya 

yB 

z 

Zc 

JW 

I  yw 

Ye, 

y'B 

‘G 

^B 

X 

Xr 

Y 

y’B 

^R 

Z 

>'»■  “ 

^R 

Xg 

Xr 

yw 

Yh 

^R 

‘fl 

wlicii’  llic  K  N  iiikl  I'.s  ale  llie  li  leliioiiialie  eocllieieiils. 
Hy  substiliiling  the  (richromatic  cocHicicnts  of  Eq.  (IK) 
info  l  i).  (21),  we  have 

K  I  (iKK  .V  ().7t4  )'  (i  t'IO/. 

G  =  -  ().yi5  A  +  1.944  >■  +  0.171  Z.  (22) 

aiul  B=  0.014  A'  -  0.0.11  >■  + 2.K  10  Z. 

1'hc  chroinaticily  coordinates  can  be  determined  in 
the  following  definitions  ; 


R 

R  +  G  +  B 
G 

R  +  G  +  B 


B 

R  +  G  +  B 


1.688  A  -0.734  )' -0.340  Z 
0.787  A  + 1. 1 79  >'  +  2.64l  Z’ 
-0.915  A  +  1.944  V'+0.l7l  Z 
0.787  A  +  1.179  y+2.64l  Z' 

0.014A-0.03!  y  +  2.8IOZ 
0.787  A  +  1.I79  y  +  2.64l  Z’ 


where  r.  g.  and  b  are  the  chromaticity  coordinates. 
Thus,  any  choice  of  color  can  be  one-to-one  homo¬ 
logously  reproduced  with  this  color  transformation. 

Although  the  color  retrieval  is  evaluated  within 
the  triangle  defined  by  R*  G*  B*  of  figure  5,  any 
color  point  outside  the  triangle  can  be  replaced  by  the 
nc;irncss  neighboring  point  on  the  boundary  of  the 
triangle,  for  example,  p  can  be  replaced  by  p'.  Since 
the  hue  is  generally  keeping  it  up,  it  will  not  introduce 
significant  adversed  effect  by  human  perception. 
In  practice,  we  need  only  to  control  the  exposure  ratio 
of  the  encodings  such  that  white  color  object  can  be 
retrieved  by  a  white-light  processor.  With  reference 
to  these  available  exposure  ratios,  a  broad  dynamic 
range  of  encodings  onto  a  typical  photographic  plate 
can  then  be  achieved,  as  shown  in  figure  6. 
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In  oiii  cx|>ci  iniL'iil.  llic  encoding  lianspniencies 
are  made  by  Kodak  Icdinieal  pan  film  2415  and 
Kodak  Mitiordin  5.|nii  ||ie  advaniage  ol  iiMiig 
Kodak  lilin  2415  is  dial  il  is  a  low  conirast  lilin  willi 
a  lelalivciy  Hal  spivlial  lesponsc.  as  sliown  in  //;;»/<(•  7. 

I  he  dislidvantage  is  lhal  diis  Him  is  coated  with  u 
thin  layer  of  dyed-gel  backing,  for  which  it  introdnees 
additional  noise  Ihrongh  the  bleaching  process. 
Although  the  mieroHIm  used  is  a  clear  base  Him. 
however,  il  is  a  high  gamma  Him  and  the  spectral 
response  decreases  somewhat  in  the  red  color  region, 
as  shown  in  Jif’tire  7.  In  order  to  compcn.siitc  this  low 
spectral  response,  one  would  encode  the  red  wave¬ 
length  with  a  higher  exposure.  Needless  to  say  that, 
the  resolution  and  contrast  of  the  retrieval  color  image 
are  also  aHectcd  by  this  developing  process  of  the  film. 

It  should  emphasize  that,  to  avoid  the  shoulder 
region  of  the  D-E  curve,  the  film  should  be  preexposed. 
Otherwise,  it  would  introduce  low  exposure  nonlinear 
cfTcct  which  causes  color  unbalance  in  the  retrieval 
image.  The  plots  of  diffraction  efficiency  versus 
exposure  for  Kodak  2415  and  .546(1  films  with 
401incs/mm  sampling  frequency,  arc  plotted  m  figure  fi. 
From  the  figure,  we  sec  that  the  bleached  encoded 
films  oiler  a  higher  diffraction  efficiency,  the  optimum 
value  occurs  at  exposures  8.50  x  10"^  mes  and 
1.95  X  I0~'  mcs.  respectively  for  Kodak  films  2415 
and  .5460.  With  these  optimum  exposures,  it  is  possible 
to  optimize  the  encoding  process  in  the  following  : 
first,  by  preexposuring  the  film  beyond  the  toe  region. 
Second,  by  subdividing  the  remaining  exposure,  taken 
the  account  of  the  film  spectral  response,  into  three 
parts  for  the  red,  green,  and  blue  color  images. 

For  experimental  demonstrations,  we  would  like 
to  provide  two  results  obtained  by  Kodak  2415  and 
Kodak  5460  encoding  films,  as  shown  respectively 
in  figures  9a  and  9b.  From  these  figures  we  see  that 
the  moire  free  color  images  can  indeed  be  obtained. 
We  also  see  that  the  retrieved  color  image,  obtained 
by  this  Kodak  Microfilm  5460,  provides  a  higher 
image  quality  (i.e.,  higher  resolution  and  lower  noise 
level).  The  primary  reason  is  that,  commercially 
available.  Kodak  2415  is  coated  with  a  thin  layer  of 
dyed-gel  backing.  Accordingly,  this  thin  layer  of  dyed- 
gel  backing  causes  additional  noise  level  through 
bleaching  process.  For  comparison,  we  also  provide 
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Fig.  7.  —  Spectral  rrxpimsea  of  KodtJi  filing  241 S  anil  .S460. 
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the  original  color  transparency  as  shown  in  figure  W. 
By  comparing  the  results  of  figure  9  with  figure  10. 
wc  sec  that  the  retrieval  color  images  arc  spectacularly 
faithful,  with  virtually  no  color  cross-talk.  Although 
the  resolution  and  contrast  are  still  far  below  the 
acceptable  stage  for  applications,  however  these 
drawbacks  may  be  overcome  by  utilizing  a  more 
suitable  film,  for  which  a  research  program  is  currently 
under  investigation.  We  are  confident  that  better 
results  would  be  obtained  from  our  future  research 
in  this  program. 


CONCLUSION 

In  conclusion,  we  would  like  to  point  out  that, 
a  technique  of  spatial  encoding  for  archival  storage 
of  color  films  utilizing  a  white-light  processing  is 
presented.  The  encoding  is  taken  place  with  red  color 
image  on  one  independent  eoordinatc.  and  blue  and 
green  color  images  on  another  independent  coordinate. 
•SO  that  the  moire  free  color  image  can  be  retrieved 
at  the  output  plane.  Wc  have  also  introduced  a 
bleaching  process  to  convert  a  negative  encoded 
image  into  a  phase  object  encoded  transparency, 
in  which  the  step  of  generating  a  p<7siiive  encoded 
transparency  can  be  avoided.  Experimental  results 
show  that  spectacularly  faithful  color  images  can  be 
obtained  with  the  technique.  Although  the  resolution 
and  contrast  are  still  below  the  general  acceptable 
stage  for  practical  application,  however  b\  using  a 
more  suitable  encoding  film  the.se  drawbacks  may  be 
eliminated. 

We  aekiumletige  the  support  of  the  L'.S.  .Air  Foree 
Office  of  Scientific  Research  grant  AFOSR-8I-0I48 
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Color  pictures  reproduced  hy  this  technique 

(.1)  obtained  hy  Kodak  2415  ; 

(b)  ohiaiiied  by  Kodak  5460. 


f-Ki  H)  Color  picture  o1  the  oriyouil  color  intake. 
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I.  Introduction 

Signal  processing  originated  with  a  group  of  electrical  engineers  whose 
inlcrcsl  wa.s  nijiinly  ceiilcrcd  on  clcclrical  eotnintinicalion.  Nonclhele.s.s,  fioin 
the  very  beginning  of  the  development  of  signal  processing,  the  interest  in  its 
ttppliealion  lo  image  procc.ssing  has  never  been  lolally  disrcgtirdcd.  In  rcccnl 
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demonstrated  tliat  the  wliitc-light  image  process('r  is  very  ee(’iu>mieal  aiui 
easy  to  operate,  in  contrast  witli  eolrercnl  coiinlerparts.  Therefore  wc  vvoiiM 
expect  that  the  white-light  image  processor  would  oiler  a  broader  range  of 
application  to  many  scientific  imageries. 

in  this  chapter,  we  have  also  described  some  of  the  recent  advances  in 
white-light  imtige  processing.  We  have  demonstrated  that  color  image 
deblurring,  color  image  subtraction,  color  image  retrieval,  and  pseudocolor 
encoding  can  be  easily  carried  out  by  the  proposed  white-light  processing 
technique.  We  have  also  shown  that  these  white-light  image  processing 
operations  can  be  evaluated  from  the  stand  point  of  conventional  linear 
systems. 

In  spite  of  the  flexibility  of  digital  image  processing,  optical  methods  offer 
the  advantage  of  capacity,  color,  simplicity,  and  cost.  Instead  of  confronting 
each  other,  wc  can  expect  a  gradual  merging  of  the  optical  and  digital 
techniques.  The  continued  development  of  optical-digital  interfaces  and 
various  electro-optics  devices  will  lead  to  a  fruitful  result:  hybrid  optical - 
digital  image  processing  techniques,  utilizing  the  strengths  of  both  processing 
operations.  Furthermore.  I  believe  that  white-light  image  processing  is  at  the 
threshold  of  widespread  application.  I  hope  that  this  chapter  will  .serve  a  basic 
foundation,  already  established  in  part,  to  help  guide  interested  readers 
toward  various  imaginative  image  processing  applications.  In  view  of  the 
great  number  of  contributors,  I  apologize  for  possible  omissions  of  appro¬ 
priate  references. 


S. 


i 


5 


Acknowledgments 


The  support  of  the  U.S.  Air  Force  OtTice  of  Scientific  Research  in  the  area  of  white-light 
optical  processing  is  gratefully  acknowledged. 


References 


1 .  1).  (iahor.  Laser  speckle  ami  its  elimination.  IHM  J.  Res.  fJci .  14.  .'1)9  ( 1 97t)| 

2  r.  T.  S  Yu.  "Optical  Information  processing"  Wiley  llnlerscieiiee).  New  N  ork,  IVK.t 
.1  (i,  I  Rogeis.  Noii-t'iilieirnl  oplu-al  phmtsmii|i  r>f»/  /.iimt  'h’llitiiti  7,  ISt(|97'| 

4  K  Uroiiile).  An  opiieal  meohereni  correlation  Opi  At  iti  21,  .7.'  ( I974| 

.'.  M.  A.  Monahan.  K.  Bromley,  and  R.  P.  Bocker,  Incoherent  optical  correlations  Proc.  IEEE 
(<S.  121  (1977) 

6.  Ci.  L.  Rogers.  "Noncoherent  Optical  I'roccssing."  Wiley.  New  York.  1977. 


50 


X.  LIST  OF  PUBLICATIONS  RESULTING  FROM  AFOSR  SUPPORT 

1.  S.  T.  Wu  and  F.  T.  S.  Yu,  "Source  Encoding  for  Image  Subtraction," 

Optics  Letters,  Vol .  6,  pp .  452-454,  September,  1981. 

2.  F.  T.  S.  Yu  and  J.  L.  Horner,  "Optical  Processing  of  Photographic 
Images,"  Optical  Engineering,  Vol.  20,  pp .  666-676,  September-- 
October  1981. 

3.  F.  T.  S.  Yu,  "Partially  Coherent  Optical  Processing  of  Images," 

SPIE  Proceedings  on  "Processing  Images  and  Data  from  Optical 
Sensors,"  Vol.  292,  pp .  2-8,  1982. 

4.  F.  T.  S.  Yu  and  J.  L.  Horner,  "Review  of  Optical  Processing  of 
images,"  SPIE  Proceedings  on  Processing  Images  and  Data  from 
Optical  Sensors,"  Vol.  292,  pp .  9-24,  1982. 

5.  F.  T.  S.  Yu,  S.  L.  Zhuang  and  T.  H.  Chao,  "Color  Photographic- 
Image  Deblurring  by  White-Light  Processing  Technique,"  Journal 
of  Optics,  Vol.  13,  pp.  57-61,  March-April,  1982. 

6.  S.  T.  Wu  and  F.  T.  S.  Yu,  "Image  Subtraction  with  Encoded  Extended 
Incoherent  Source,"  Applied  Optics,  Vol.  20,  pp .  4082-4088, 

December  1981. 

7.  F.  T.  S.  Yu,  S.  L.  Zhuang  and  S.  T.  Wu,  "Source  Encoding  for 
Partial  Coherent  Optical  Processing,"  Applied  Physics,  Vol.  B27, 
pp.  99-104,  February  1982. 

8.  S.  T.  Wu  and  F.  T.  S.  Yu,  "Visualization  of  Color  Coded  Phase 
Object  Variation  with  Incoherent  Optical  Processing  Technique," 

Journal  of  Optics,  Vol.  13,  p  p  111-114,  May-June,  1982. 

9.  S.  L.  Zhuang  and  F.  T.  S.  Yu,  "Coherence  Requirement  for  Partially 
Coherent  Optical  Information  Processing,"  Applied  Optics, 

Vol.  21,  pp.  2587-2595,  July  1982. 

10.  F.  T.  S.  Yu  and  S.  T.  Wu,  "Color  Image  Subtraction  with  Encoded 

Extended  Incoherent  Source,"  Journal  of  Optics,  183  (1982). 

11.  S.  L.  Zhuang  and  F.  T.  S.  Yu,  "Apparent  Transfer  Function  for 
Partially  Coherent  Optical  Information  Processing,"  Applied  Physics, 

B28,  359-366,  August,  1982. 

12.  Y.  W.  Zhang,  W.  G.  Zhu,  and  F.  T.  S.  Yu,  "Rainbow  Holographic 

Aberrations  and  Bandwidth  Requirements,"  Applied  Optics  .  164  (1983). 

13.  F.  T.  S.  Yu,  X.  X.  Chen,  and  S.  L.  Zhuang,  "Progress  Report  on 
Archival  Storage  of  Color  Films  with  White-Light  Processing  Tech¬ 
nique,"  submitted  to  Applied  Optics. 


14.  T.  H.  Chao,  S.  L.  Zhuang,  S.  Z.  Mao  and  F.  T.  S.  Yu,  "Broad 

Spectral  Band  Color  Image  Deblurring ,"  Applied  Optics  .  2_2.  1^39  (1983)- 

15.  F.  T.  S.  Yu,  Optical  Information  Processing,  Wiley-lnterscience , 


N.Y.  ,  1983. 


16.  F.  T.  S.  Yu,  "Source  Encoding,  Signal  Sampling  and  Filtering  for 
White-Light  Signal  Processing,"  Proceedings  of  10th  International 
Optical  Computer  Conference,  pp.  111-116,  April  6-8,  1983. 

17.  X.  J.  Lu  and  F.  T.  S.  Yu,  "Restoration  of  Out-of-Focused  Color 
Photographic  Images,"  Optics  Communications,  Vol.  46,  pp.  278-833. 
July  (1983). 

18.  C.  Warde,  H.  J.  Caulfield,  F.  T.  S.  Yu  and  J.  E.  Ludman,  "Real-Time 
Joint  Spectral-Spatial  Matched  Filtering,"  Optics  Communications, 
Vol.  49,  pp.  241-244,  March  (1984). 

19.  F.  T.  S.  Yu,  "Source  Encoding,  Signal  Sampling  and  Spectral  Band 
Filtering  for  Partially  Conerent  Optical  Signal  Processing," 

Journal  of  Optics,  Vol.  14,  pp.  173“ 178,  July-August  (1983). 

20.  F.  T.  S.  Yu,  "Recent  Advances  in  White-Light  Optical  Signal 
Processing,"  Conference  on  Laser  and  Electro-Optics,  Cleo  '83 
Technical  Digest,  pp.  28-30,  May  (1983). 


21 .  F.  T.  S.  Yu,  X.  X.  Chen  and  T.  H.  Chao,  "Density  Pseudocolor 
Encoding  with  Three  Primary  Colors,"  Journal  of  Optics,  Vol.  15, 
pp.  55-58,  March-April  (1984). 

22.  F.  T.  S.  Yu,  S.  L.  Zhang  and  K.  S.  Shaik,  "Noise  Performance  of  a 
White-Light  Optical  Signal  Processor:  Part  I,  Temporally  Partially 
Coherent  Illumination,  Journal  of  the  Optical  Society  of  America  A, 
Vol.  1,  pp.  489-494,  May  (1984). 

23.  F.  T.  S.  Yu,  F.  K.  Hsu  and  T.  H.  Chao,  "Coherence  Measurement  of  a 
Grating-Based  White-Light  Optical  Signal  Processor,"  Applied  Optics, 
Vol.  23,  pp.  333-340,  January  (1984). 

24.  F.  T.  S.  Yu,  "Advances  in  White-Light  Optical  Signal  Processing," 
Proceedings  on  Optical  Information  Processing  Conference  II,  NASA 
CP-2303  Conference  publication,  pp.  53-69,  August  (1983). 

25.  S.  L.  Zhuang,  "Coherence  Requirements,  Transfer  Functions  and 
Noise  Performance  of  a  Partially  Coherent  Optical  Processor," 

Ph.D,  Dissertation,  Pennsylvania  State  University,  University  Park, 
PA,  1983. 

26.  T.  H.  Chao,  "A  Grating-Based  White-Light  Optical  Signal  Processor," 
Ph.D.  Dissertation,  Pennsylvania  State  University,  University  Park, 
PA,  1983. 


I 


52 


I 

y* 


I 


^  • 
K\ 

I 

e 

■ 

r^ 


27.  X.  J.  Lu,  "Pseudocolor  Encoding  with  White-Light  Processing  System," 
Optics  Communications,  pp.  13“16,  November  (1983). 

28.  J.  E.  Ludman,  B.  Javidi,  F.  T.  S.  Yu,  H.  J.  Caulfield  and  C.  Warde, 
"Real-Time  Colored-Pattern  Recognition,"  SPIE  Proceedings  of  Spatial 
Light  Modulators  and  Applications,  Vol.  ^465,  pp.  1^3“1^9,  January 
19844. 

29.  F.  T.  S.  Yu,  X.  X.  Chen  and  S.  L.  Zhuang,  "Progress  Report  on  Archival 
Storage  of  Color  Films  Utilizing  a  White-Light  Processing  Technique," 
Journal  of  Optics,  Vol.  16,  pp.  59*61,  January-February  (1985). 

30.  F.  T.  S.  Yu,  T.  N.  Lin  and  K.  B.  Xu,  "White-Light  Optical  Speech 
Spectrogram  Generation,"  Applied  Optics,  Vol.  244,  pp.  836-8441  ,  March 
(1985). 

31 .  F.  T.  S.  Yu  and  G.  W.  Petersen,  "A  Low-Cost  High-Ouality  Pseudocolor 
Encoder  for  Remote  Sensing  Applications,"  submitted  to  Photogrammetric 
Engineering  and  Remote  Sensing. 

32.  B.  Javidi  and  F.  T.  S.  Yu,  "Optics  at  Pennsylvania  State  University," 
Optical  Engineering,  Vol.  23,  SR,  pp.  068-071  ,  May/June  (1  9844  ). 

33.  F.  T.  S.  Yu,  X.  J.  Lu  and  M.  F.  Cao,  "Applications  of  Magneto-Optic 
Spatial  Light  Modulator  to  White-Light  Optical  Processing,"  Applied 
Optics,  Vol.  23,  pp.  441  00-441014  ,  November  (1  9844  ). 

344.  F.  T.  S.  Yu  and  X.  X.  Chen,  "Solar  Optical  Processing,"  Optics 
Communications,  Vol.  51,  pp.  377-381  ,  October  (1  9844  ). 

35.  F.  T.  S.  Yu  and  H.  Mueller,  "A  Low-Cost  White-Light  Optical 
Processor,"  IEEE  Transaction  of  Education  (in  press). 

36.  F.  T.  S.  Yu,  "Recent  Advances  in  White-Light  Image  Processing,"  ICO-13 
Conference  Digest  on  "Optics  in  Modern  Science  and  Technology,"  pp. 
4412-1413,  August  (1  9844). 

37.  F.  T.  S.  Yu  and  X.  X.  Chen,  "A  Low-Cost  White-Light  Pseudocolor 
Encoder  for  Astronomical  Imaging  Applications,"  International 
Conference  on  "Progress  in  Optical  Physics,"  Melbourne,  Australia, 
August  15-17,  1  9844. 

38.  F.  T.  S.  Yu,  L.  N.  Zheng  and  F.  K.  Hsu,  "Noise  Measurement  of  a 
White-Light  Optical  Signal  Processor,"  Applied  Optics,  Vol.  244  ,  pp. 
173-178,  January  (1985). 

39.  H.  M.  Mueller,  "A  Low-Cost  White-Light  Optical  Processor,"  M.S. 
Dissertation,  Pennsylvania  State  University,  University  Par4<,  PA, 

1  9844  . 

440.  F.  T.  S.  Yu  and  F.  K.  Hsu,  "White-Light  Fourier  Holography,"  Optics 
Communications,  Vol.  52,  pp.  3844-388,  January  (1985). 


53 


I 


I 


!  s? 

t 

E 


\ 


r^ 


41.  F.  T.  S.  Yu  and  F.  K.  Hsu,  "Generation  of  Broadband  Fourier 
Holograms,"  SPIE  Proceedings  on  "Application  of  Holography,"  Vol.  523, 
pp.  319-323,  January  (1985). 

42.  F.  T.  S.  Yu,  White-Light  Optical  Signal  Processing, 

Wiley-Interscience ,  NY,  May  1985. 

43.  F.  T.  S.  Yu,  "Garden  of  White-Light  Optical  Signal  Processing,"  Optics 
News,  Vol.  11,  pp.  5-8,  May  ( 1 985 )( invited ) . 

44.  F.  K.  Hsu,  "White-Light  Fourier  Transform  Holography,"  M.S. 
Dissertation,  Pennsylvania  State  University,  University  Park,  PA, 

1985. 

45.  M.  S.  Dyraek,  "Color  Image  Processing  with  Computer-Generated  Spatial 
Filters  in  a  Dispersed  White-Light  Optical  System,"  Ph.D. 

Dissertation,  Pennsylvania  State  University,  University  Park,  PA, 

1985. 


— 1 - - 


